-- Logs begin at Thu 2022-05-05 12:56:24 UTC, end at Thu 2022-05-05 14:45:22 UTC. -- May 05 13:45:09.897379 dv-cinder-737618-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 05 13:45:09.906786 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 13:45:09 2022] *** May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: nodename: dv-cinder-737618-3-iscsi May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: machine: x86_64 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: clock source: unix May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: pcre jit disabled May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: detected number of CPU cores: 4 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: current working directory: / May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: detected binary path: /usr/bin/uwsgi-core May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: your processes number limit is 47680 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: your memory page size is 4096 bytes May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: detected max file descriptor number: 2048 May 05 13:45:09.908754 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: lock engine: pthread robust mutexes May 05 13:45:09.909632 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: thunder lock: enabled May 05 13:45:09.909632 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 05 13:45:09.909632 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 13:45:09.953934 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: Python main interpreter initialized at 0x55a5879fa9c0 May 05 13:45:09.953934 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: python threads support enabled May 05 13:45:09.953934 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: your server socket listen backlog is limited to 100 connections May 05 13:45:09.953934 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: your mercy for graceful operations on workers is 90 seconds May 05 13:45:09.954289 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: mapped 403077 bytes (393 KB) for 2 cores May 05 13:45:09.954367 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: *** Operational MODE: preforking *** May 05 13:45:09.954624 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: *** uWSGI is running in multiple interpreter mode *** May 05 13:45:09.954624 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: spawned uWSGI master process (pid: 109559) May 05 13:45:09.954811 dv-cinder-737618-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 05 13:45:09.955640 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: spawned uWSGI worker 1 (pid: 109560, cores: 1) May 05 13:45:09.955741 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: spawned uWSGI worker 2 (pid: 109561, cores: 1) May 05 13:45:09.957299 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 13:45:11.191528 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 05 13:45:11.192139 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 05 13:45:11.927155 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:45:11.927155 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: from cryptography.utils import int_from_bytes May 05 13:45:11.927491 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:45:11.927491 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: from cryptography.utils import int_from_bytes May 05 13:45:11.929548 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:45:11.929548 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: from cryptography.utils import int_from_bytes May 05 13:45:11.929877 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:45:11.929877 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: from cryptography.utils import int_from_bytes May 05 13:45:14.545382 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:45:14.546001 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:45:14.546133 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:45:14.546133 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:45:14.546532 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:45:14.546613 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:45:14.546681 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:45:14.546681 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:45:14.546808 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:45:14.547031 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:45:14.547143 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.547375 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.547470 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.547696 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.547783 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.548049 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.548375 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.548468 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.548714 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.548821 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549025 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549112 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549346 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549441 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549667 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549753 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.549997 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550104 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550283 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550380 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550602 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550697 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.550929 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-3-iscsi {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551016 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-3-iscsi {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551260 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551397 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551573 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551682 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551880 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.551990 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552202 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552296 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552508 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552611 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552833 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.552927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.553141 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.553240 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.553646 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.553779 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.554980 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555116 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555200 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555280 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555357 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555432 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555505 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555574 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555641 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555716 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555784 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555857 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.555933 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556010 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556280 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556382 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556550 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556649 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556860 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.556984 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.557261 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-3-iscsi {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.557355 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-3-iscsi {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.557580 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.557683 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.557896 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558001 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558251 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558338 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558646 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558760 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.558960 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.559656 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.559834 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.559925 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560140 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560233 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560463 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560564 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560775 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.560933 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561101 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561255 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561421 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561574 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561726 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.561880 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562081 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562230 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562371 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562510 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562662 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562811 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.562960 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563099 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563238 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563387 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563533 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563673 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563823 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.563963 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564102 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564250 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564398 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564563 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564715 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564856 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.564997 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.565145 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.565286 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.565430 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.565668 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.565825 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566086 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566238 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566380 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566527 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566669 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566829 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.566972 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567119 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567271 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567428 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567572 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567721 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.567862 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568001 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568141 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568280 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568435 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568585 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568726 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.568865 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569003 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569160 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569300 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569448 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569588 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569728 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.569866 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570004 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570215 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570357 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570508 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570649 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570788 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.570927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571085 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571237 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571383 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571522 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571661 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571799 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.571947 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572106 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572246 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572386 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572531 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572680 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572829 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.572978 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573118 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573263 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573404 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573552 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573692 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573831 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.573978 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574170 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574324 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574474 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574617 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574771 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.574926 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575067 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575206 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575354 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575495 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575647 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575786 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.575926 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576064 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576212 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576352 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576492 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576641 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576781 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.576933 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.577079 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.577219 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.577373 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.577761 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.577911 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578086 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578240 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578381 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578521 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578661 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578809 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.578956 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579104 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579250 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579390 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579529 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579668 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579815 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.579962 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.580102 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.580311 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.580459 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.580688 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.580861 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581013 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581160 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581306 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581455 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581601 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581751 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.581893 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582083 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582230 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582381 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582521 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582669 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582820 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.582972 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583113 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583252 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583400 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583552 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583700 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583840 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.583986 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584126 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584275 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584416 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584556 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584705 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584845 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.584985 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585132 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585272 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585412 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585551 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585690 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585829 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.585977 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586174 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586323 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586474 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586615 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586755 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.586902 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587044 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587191 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587332 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587482 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587623 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587772 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.587920 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588061 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588200 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588349 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588502 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588643 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588782 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.588921 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589105 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589253 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589402 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589542 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589718 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.589880 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.590067 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.590216 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.590413 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:45:14.590558 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.590697 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.590837 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591039 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591196 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591389 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591537 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591711 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.591858 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592036 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592262 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592417 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592557 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592703 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592850 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.592991 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593144 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593286 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593425 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593565 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593712 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.593852 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594004 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594179 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594345 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594487 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594625 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594778 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.594938 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595177 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595325 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595477 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595617 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595795 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.595960 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596102 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596241 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596416 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596572 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596744 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.596899 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597066 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597221 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597362 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597503 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597700 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.597850 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598069 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598219 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598371 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598521 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598675 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598815 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.598955 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599095 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599271 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599418 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599568 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599708 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.599876 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600023 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600196 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600363 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600510 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600658 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600822 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.600969 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601139 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601299 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601440 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601587 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601750 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.601898 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602067 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602225 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602376 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602529 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602671 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602812 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.602997 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603153 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603315 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603462 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603630 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603785 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.603934 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604085 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604235 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604376 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604522 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604668 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604818 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.604959 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605128 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605276 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605415 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605555 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605707 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.605849 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.606545 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.606705 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.606846 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.606987 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607139 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607280 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607452 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607600 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607779 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.607934 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608088 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608237 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608404 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608559 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608710 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.608858 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609000 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609147 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609287 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609427 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609593 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609750 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.609891 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610059 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610207 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610347 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610520 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610690 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610831 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.610971 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611119 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611259 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611431 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611588 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611736 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.611877 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612047 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612203 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612352 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612492 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612649 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612790 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.612930 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613069 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613218 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613359 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613528 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613687 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613829 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.613968 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614181 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614325 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614475 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614616 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614755 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.614894 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615110 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615266 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615407 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615547 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615686 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615834 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.615974 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616113 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616305 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616471 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616634 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616790 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.616938 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617091 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617231 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617371 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617534 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617691 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617832 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.617972 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618150 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618303 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618474 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618702 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618849 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.618989 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619129 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619269 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619418 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619560 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619700 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.619851 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620000 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620140 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620288 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620443 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620592 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620732 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.620872 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.621011 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.621162 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.621303 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.621443 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622253 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622406 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622547 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622704 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622857 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.622999 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623138 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623286 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623436 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623578 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623719 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623858 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.623997 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624137 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624289 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624429 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624570 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624720 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.624861 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625033 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625190 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625331 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625471 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625644 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625793 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.625941 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626124 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626292 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626440 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626587 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626737 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.626911 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627060 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627224 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627372 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627551 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627706 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.627867 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628015 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628168 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628325 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628475 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628629 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628800 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.628956 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629103 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629250 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629404 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629552 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629708 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.629856 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630003 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630196 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630346 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630492 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630648 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630812 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.630960 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631107 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631254 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631409 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631556 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631702 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631848 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.631995 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632151 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632307 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632455 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632618 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632766 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.632912 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633066 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633224 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633371 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633517 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633662 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633808 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.633954 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634169 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634327 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634483 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634640 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634794 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.634949 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635097 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635244 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635391 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635539 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635685 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635840 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.635987 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636147 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636294 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636447 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636604 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636764 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.636918 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637065 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637246 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637397 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637550 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637706 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.637861 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638008 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638197 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638357 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638514 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638672 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638827 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.638974 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639127 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639275 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639431 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639579 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639725 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.639871 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640017 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640177 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640337 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640496 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640643 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640789 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.640942 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641089 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641245 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641392 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641539 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641685 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641831 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.641977 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642168 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642318 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642474 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642622 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642769 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.642923 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643072 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643218 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643364 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643518 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643674 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.643895 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644044 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644192 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644338 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644495 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644644 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644800 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.644949 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645095 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645242 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645389 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645536 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645696 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645843 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.645990 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.646219 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.646384 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.646384 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.646699 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.646848 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647008 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647164 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647311 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647470 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647617 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647772 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.647927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648074 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648221 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648389 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648548 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648701 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648849 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.648996 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649143 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649299 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649446 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649593 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649739 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.649886 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650086 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650256 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650416 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650564 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650710 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.650857 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651021 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651170 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651316 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651316 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651594 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651755 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.651912 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652060 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652207 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652207 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652508 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652655 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652839 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.652990 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653146 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653300 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653447 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653606 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653762 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.653910 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654092 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654261 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654419 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654566 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654720 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.654874 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655021 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655177 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655333 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655490 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655646 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655794 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.655950 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656104 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656262 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656409 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656556 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656712 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.656868 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657015 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657162 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657310 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657457 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657616 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657773 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.657928 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658140 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658321 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658473 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658630 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658778 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.658934 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659081 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659229 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659384 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659540 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659695 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659843 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.659997 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660145 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660311 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660460 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660608 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660764 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.660912 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661059 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661218 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661374 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661522 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661670 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661818 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.661965 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662146 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662246 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662333 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662415 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662510 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662618 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662701 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662789 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.662991 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663101 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663298 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663398 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663607 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663704 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.663924 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664025 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664229 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664326 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664531 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664617 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664836 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.664925 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665143 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665239 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665453 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665540 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665764 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.665863 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666085 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666177 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666398 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666498 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666705 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.666793 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667016 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667106 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667321 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667407 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667623 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667712 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.667926 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.668021 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.668238 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.668337 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669062 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669151 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669366 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669460 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669669 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669772 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.669970 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670070 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670313 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670403 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670621 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670709 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.670924 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671021 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671229 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671317 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671542 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671631 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671850 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.671946 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672150 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672238 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672456 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672542 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672770 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.672867 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673077 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673175 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673379 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673466 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673687 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673782 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.673991 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674098 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674320 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674408 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674624 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674712 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.674938 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675033 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675245 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675341 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675547 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675635 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.675859 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676032 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676195 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676345 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676507 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676657 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676803 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.676957 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677108 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677256 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677414 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677562 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677709 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.677855 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678002 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678199 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678357 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678512 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678660 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678806 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.678953 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679109 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679258 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679405 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679564 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679712 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.679858 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680044 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680203 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680352 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680499 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680646 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.680810 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681054 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681222 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681373 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681519 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681667 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681823 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.681972 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682157 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682306 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682454 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682600 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682757 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.682906 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683053 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683199 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683345 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683500 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683656 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683811 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.683958 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.684664 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.684813 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.684960 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685116 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685271 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685418 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685565 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685711 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.685866 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686050 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686205 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686361 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686509 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686667 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686822 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.686976 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687128 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687275 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687428 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687575 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687731 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.687879 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688032 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688179 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688326 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688473 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688638 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688787 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.688932 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689079 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689224 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689383 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689532 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689678 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689825 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.689971 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690141 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690301 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690450 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690607 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690755 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.690901 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691056 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691212 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691367 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691514 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691668 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691815 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.691970 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692132 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692288 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692445 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692592 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692739 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.692895 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693043 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693196 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693343 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693496 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693643 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693803 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.693952 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694123 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694271 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694430 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694589 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694745 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.694893 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695048 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695195 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695342 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695488 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695644 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695792 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.695938 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696086 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696232 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696461 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696610 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696763 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.696912 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697069 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697218 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697373 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697521 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697668 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697822 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.697969 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698147 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698308 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698474 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698623 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698769 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.698923 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699070 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699227 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699376 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699530 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699704 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.699854 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700015 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700171 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700333 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700481 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700629 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700775 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.700930 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701078 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701225 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701372 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701527 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701674 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701835 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.701982 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702123 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702123 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702266 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702411 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702513 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.702976 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703065 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703305 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703465 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703622 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703770 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.703940 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704101 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704249 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704407 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704562 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704710 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.704856 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705026 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705187 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705336 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705491 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705639 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705795 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.705945 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706150 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706310 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706458 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706616 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706843 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.706994 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707140 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707287 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707434 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707582 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707737 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.707895 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708044 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708192 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708351 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708507 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708656 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708802 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.708948 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709095 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709249 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709405 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709562 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709711 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.709858 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710031 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710187 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710356 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710506 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710661 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710810 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.710964 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711119 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711276 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711424 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711571 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711719 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.711866 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712027 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712185 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712332 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712486 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712641 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712789 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.712945 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713094 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713240 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713387 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713535 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713688 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.713849 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714005 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714218 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714366 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714513 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714660 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714818 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.714975 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715122 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715299 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715452 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715609 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715758 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.715904 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716065 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716222 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716369 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716524 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716672 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716819 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.716967 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717122 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717269 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717424 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717572 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717726 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.717883 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718067 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718231 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718390 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718538 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718702 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.718941 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719119 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719284 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719433 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719579 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719579 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719859 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.719859 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720163 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720163 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720444 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720591 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720738 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.720885 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721040 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721187 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721342 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721490 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721636 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721783 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.721938 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722142 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722302 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722450 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722597 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722752 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.722907 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723062 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723216 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723364 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723518 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723674 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723822 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.723975 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724136 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724283 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724438 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724594 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724742 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.724889 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725035 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725189 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725336 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725493 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725648 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725796 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.725950 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726136 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726298 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726448 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726594 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726749 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.726896 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727042 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727197 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727353 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727501 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727648 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727808 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.727971 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728128 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728283 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728439 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728587 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728734 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.728881 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729036 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729184 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729331 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729478 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729625 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729780 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.729938 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.730136 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.730298 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.730447 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.730594 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.730751 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.731415 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.731576 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.731725 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.731725 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732013 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732174 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732323 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732480 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732627 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732774 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.732928 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733085 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733233 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733233 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733512 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733660 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733814 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.733963 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734129 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734231 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734344 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734434 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734662 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734753 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.734980 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735070 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735296 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735386 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735610 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735714 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.735927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736017 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736244 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736341 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736558 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736656 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736881 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.736975 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737196 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737293 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737523 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737617 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737859 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.737946 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738192 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738301 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738510 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738597 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738836 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.738921 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739138 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739228 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739452 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739540 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739764 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.739852 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740079 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740168 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740391 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740479 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740703 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.740801 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741016 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741123 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741327 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741415 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741637 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741733 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.741950 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742067 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742292 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742383 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742610 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742708 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.742920 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743008 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743235 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743325 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743548 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743645 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.743881 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744068 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744219 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744389 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744542 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744726 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.744859 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.745060 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.745175 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.745388 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.745485 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.745706 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.746005 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.746116 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.746347 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.746452 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747209 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747302 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747520 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747609 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747833 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.747930 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748143 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748231 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748448 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748536 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748772 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.748868 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749099 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749186 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749404 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749492 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749729 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.749826 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750060 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750161 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750373 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750593 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750691 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.750940 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751029 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751260 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751348 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751590 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751687 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.751907 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752008 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752223 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752443 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752532 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752789 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.752879 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753108 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753197 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753426 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753519 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753743 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.753831 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754073 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754163 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754382 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754492 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754690 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.754780 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755004 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755093 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755311 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755406 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755615 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755702 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.755927 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756014 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756232 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756328 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756538 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756632 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756853 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.756940 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757157 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757254 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757461 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757556 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757772 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.757866 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758098 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758190 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758407 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758495 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758714 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.758810 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759018 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759108 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759323 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759410 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759625 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759711 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.759933 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760025 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760234 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760328 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760541 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760635 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760843 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.760931 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761152 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761240 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761457 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761554 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761773 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.761868 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762104 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762214 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762454 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762558 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762770 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.762859 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763084 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763174 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763408 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763512 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763721 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.763852 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764035 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764122 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764383 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764483 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764699 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.764788 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765013 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765236 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765405 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765573 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765661 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765893 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.765989 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.766251 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.766359 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.766585 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.766674 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.766893 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767141 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767229 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767493 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767582 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767815 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.767902 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768128 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768217 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768440 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768529 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768751 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.768840 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769061 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769158 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769371 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769462 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769679 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769765 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.769987 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770157 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770321 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770417 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770630 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770718 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.770944 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771045 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771252 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771346 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771563 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771652 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771875 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.771971 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772190 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772278 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772504 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772600 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772818 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.772907 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773132 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773219 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773444 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773538 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773752 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.773839 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774083 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774175 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774394 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774494 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774702 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.774791 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775018 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775113 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775350 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775445 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775665 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775754 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.775971 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776057 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776280 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776377 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776604 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776700 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.776926 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777015 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777266 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777364 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777584 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777680 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.777920 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778024 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778283 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778379 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778599 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778700 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.778922 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779010 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779234 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779323 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779563 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779651 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779899 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.779988 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780229 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780324 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780544 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780639 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780848 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.780944 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781153 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781248 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781466 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781561 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781779 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.781881 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782120 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782212 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782430 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782520 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782734 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.782832 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783039 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783128 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783350 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783439 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783655 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783751 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.783958 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784054 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784264 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784353 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784568 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784658 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784874 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.784962 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785180 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785275 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785485 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785580 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785786 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.785874 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786114 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786205 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786421 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786512 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786724 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.786812 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787030 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787125 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787332 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787419 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787635 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787724 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.787938 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788034 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788241 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788337 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788545 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788639 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788856 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.788959 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789164 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789254 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789471 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789560 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789777 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.789874 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790112 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790227 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790422 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790516 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790732 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.790821 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791055 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791200 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791377 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791475 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791691 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.791793 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792002 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792090 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792327 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792425 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792636 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792724 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.792949 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.793045 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.793261 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.793357 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794106 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794208 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794424 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794515 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794733 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.794899 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795062 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795158 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795376 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795502 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795687 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795784 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.795997 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796086 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796313 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796411 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796633 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796730 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.796963 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797051 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797281 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797370 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797591 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797681 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.797927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798036 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798284 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798373 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798599 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798694 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.798912 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799001 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799227 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799322 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799546 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799635 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799866 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.799956 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800182 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800278 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800504 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800602 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800823 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.800913 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.801149 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.801472 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.801621 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.801775 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.801917 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802122 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802260 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802463 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802608 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802796 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.802969 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803118 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803276 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803455 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803607 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803749 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.803888 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.804040 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:45:14.804188 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.804433 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.804753 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.805073 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.805383 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:45:14.805629 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:45:14.832832 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_db.sqlalchemy.engines [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:14.834982 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_db.sqlalchemy.engines [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:14.897007 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.context [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8fe454e-7513-4ff7-93a5-967e7a71a07d(cell1) {{(pid=109560) load_cells /opt/stack/nova/nova/context.py:464}} May 05 13:45:14.898525 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.context [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8fe454e-7513-4ff7-93a5-967e7a71a07d(cell1) {{(pid=109561) load_cells /opt/stack/nova/nova/context.py:464}} May 05 13:45:14.901443 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_concurrency.lockutils [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:45:14.903328 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:45:14.903591 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_concurrency.lockutils [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:45:14.904395 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_concurrency.lockutils [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:45:14.904877 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:45:14.905673 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:45:14.906352 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_concurrency.lockutils [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:45:14.907616 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:45:14.919618 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_db.sqlalchemy.engines [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:14.920889 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_db.sqlalchemy.engines [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:14.923503 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_db.sqlalchemy.engines [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:14.927023 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_db.sqlalchemy.engines [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:15.089064 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG oslo_db.sqlalchemy.engines [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:15.092936 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_db.sqlalchemy.engines [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:45:15.539086 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: WARNING keystonemiddleware.auth_token [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:45:15.545641 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: WARNING keystonemiddleware.auth_token [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:45:15.573905 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: WARNING keystonemiddleware.auth_token [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:45:15.581353 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: WARNING keystonemiddleware.auth_token [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:45:15.893563 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: WARNING keystonemiddleware.auth_token [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:45:15.898878 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: WARNING keystonemiddleware.auth_token [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:45:15.904530 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5879fa9c0 pid: 109560 (default app) May 05 13:45:15.906628 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:45:15.907807 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 May 05 13:45:15.908311 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu May 5 13:45:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:45:15.925683 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: WARNING keystonemiddleware.auth_token [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:45:15.931079 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: WARNING keystonemiddleware.auth_token [None req-a54b75ab-85b4-463b-b51b-bfbd98013dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:45:15.936219 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5879fa9c0 pid: 109561 (default app) May 05 13:46:37.041163 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:37.042851 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 May 05 13:46:37.043470 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:37.477739 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-f741b123-d2b2-4763-a46b-4562ed7a11fe admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:37.506762 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-f741b123-d2b2-4763-a46b-4562ed7a11fe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.456790 May 05 13:46:37.507532 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Thu May 5 13:46:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:46:39.789696 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:39.790716 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-39c55c33-5635-4a6e-8b8d-1440375f65eb None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 05 13:46:39.791114 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:39.852424 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-d4509d41-c812-4c08-9a9c-fd4fb4bd4270 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:39.872052 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:46:39.872052 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:46:39.956691 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-d4509d41-c812-4c08-9a9c-fd4fb4bd4270 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.159876 May 05 13:46:39.957354 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:46:40.175268 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-89d14b03-72e4-48d1-84d4-861e414f030a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:40.178113 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:46:40.178113 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: warnings.warn(msg) May 05 13:46:40.319541 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-89d14b03-72e4-48d1-84d4-861e414f030a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353771 May 05 13:46:40.320424 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Thu May 5 13:46:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:46:42.608067 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-d4509d41-c812-4c08-9a9c-fd4fb4bd4270 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:42.609209 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-d4509d41-c812-4c08-9a9c-fd4fb4bd4270 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 May 05 13:46:42.609630 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:42.722682 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-e2b63ae4-34cd-4074-a3dd-32cec2b84969 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "ram": 512}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:42.740981 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:46:42.740981 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: warnings.warn(msg) May 05 13:46:42.818775 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-e2b63ae4-34cd-4074-a3dd-32cec2b84969 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.203259 May 05 13:46:42.821692 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 05 13:46:42.832122 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-4ac3943f-eba9-41e6-9fca-785aa7887f75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:42.833591 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:46:42.833591 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:46:42.922845 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-4ac3943f-eba9-41e6-9fca-785aa7887f75 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094519 May 05 13:46:42.923374 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Thu May 5 13:46:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:46:45.210042 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-e2b63ae4-34cd-4074-a3dd-32cec2b84969 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:45.211139 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-e2b63ae4-34cd-4074-a3dd-32cec2b84969 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 05 13:46:45.211886 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:45.271547 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-27c1866c-b5da-45af-903e-af7e3f654a52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:45.338777 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-27c1866c-b5da-45af-903e-af7e3f654a52 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120580 May 05 13:46:45.339621 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:46:45.351095 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-ee55bdaf-95a0-4688-a323-254c84a3efc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:45.447468 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-ee55bdaf-95a0-4688-a323-254c84a3efc0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099935 May 05 13:46:45.448573 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Thu May 5 13:46:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:46:47.784472 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-27c1866c-b5da-45af-903e-af7e3f654a52 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:47.785489 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-27c1866c-b5da-45af-903e-af7e3f654a52 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 05 13:46:47.785893 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:47.847386 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-c475f56f-a503-4b23-a334-b832e9c16c38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:47.935728 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-c475f56f-a503-4b23-a334-b832e9c16c38 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143706 May 05 13:46:47.936286 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 05 13:46:47.951793 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-50e8eb82-2a20-4bce-be02-5a11323ee14a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:48.032625 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-50e8eb82-2a20-4bce-be02-5a11323ee14a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085117 May 05 13:46:48.037422 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Thu May 5 13:46:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:46:50.347828 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-c475f56f-a503-4b23-a334-b832e9c16c38 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:50.348764 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-c475f56f-a503-4b23-a334-b832e9c16c38 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 05 13:46:50.349158 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:50.408488 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "swap": 0, "name": "ds4G"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:50.487065 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132099 May 05 13:46:50.487741 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:46:50.499927 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-ee9e3fc2-e0e7-4d32-88c7-3aaaceaee9ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:50.596222 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-ee9e3fc2-e0e7-4d32-88c7-3aaaceaee9ba admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100120 May 05 13:46:50.597029 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Thu May 5 13:46:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:46:52.892691 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:52.893772 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 05 13:46:52.894355 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:52.951771 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-3b89ae97-ccde-4af0-af21-bc2b0c0436fa admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:52.977221 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-3b89ae97-ccde-4af0-af21-bc2b0c0436fa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076936 May 05 13:46:52.977758 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Thu May 5 13:46:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:46:55.275434 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:55.276792 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-2e508e64-333f-4b3f-b3f9-7d68cadf3579 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001936 May 05 13:46:55.277342 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:55.344798 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-f87634b7-4299-48cd-97c7-d5061ff0d9ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:55.423721 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-f87634b7-4299-48cd-97c7-d5061ff0d9ea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.140445 May 05 13:46:55.424230 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:46:55.437894 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-8abb5388-fb01-4393-ab8c-0ba7de34dda1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:55.556411 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-8abb5388-fb01-4393-ab8c-0ba7de34dda1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123147 May 05 13:46:55.557564 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Thu May 5 13:46:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:46:57.990623 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-f87634b7-4299-48cd-97c7-d5061ff0d9ea admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:46:57.991633 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-f87634b7-4299-48cd-97c7-d5061ff0d9ea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 05 13:46:57.992041 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:46:58.055011 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a65373e6-268a-41a9-aa4d-a9a668600d86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:58.183531 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a65373e6-268a-41a9-aa4d-a9a668600d86 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.183789 May 05 13:46:58.184017 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:46:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:46:58.195867 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-79c4f62e-1c38-46b0-aed8-f4ecad0ec858 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:46:58.281632 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-79c4f62e-1c38-46b0-aed8-f4ecad0ec858 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089381 May 05 13:46:58.282249 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Thu May 5 13:46:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:47:00.651151 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a65373e6-268a-41a9-aa4d-a9a668600d86 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:00.652706 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a65373e6-268a-41a9-aa4d-a9a668600d86 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 May 05 13:47:00.653102 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:00.709807 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-cded6d23-808d-4cc8-8c4e-aae3cbdc7fe5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:00.804165 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-cded6d23-808d-4cc8-8c4e-aae3cbdc7fe5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.145268 May 05 13:47:00.804862 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:47:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:00.816841 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-3d8b89fc-1bcf-428f-aff1-19c3ed45d1dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:00.904160 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-3d8b89fc-1bcf-428f-aff1-19c3ed45d1dc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091012 May 05 13:47:00.904662 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Thu May 5 13:47:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:47:03.197316 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-cded6d23-808d-4cc8-8c4e-aae3cbdc7fe5 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:03.198414 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-cded6d23-808d-4cc8-8c4e-aae3cbdc7fe5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 05 13:47:03.198820 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:03.258667 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-f1e180da-22e0-40a8-8041-03c45ade8495 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:03.332467 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-f1e180da-22e0-40a8-8041-03c45ade8495 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.127258 May 05 13:47:03.333198 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:47:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:03.357908 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-34c9808c-f841-4495-b512-7ad6c4d17340 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:03.444413 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-34c9808c-f841-4495-b512-7ad6c4d17340 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102506 May 05 13:47:03.445153 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Thu May 5 13:47:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:47:05.806865 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-f1e180da-22e0-40a8-8041-03c45ade8495 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:05.808548 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-f1e180da-22e0-40a8-8041-03c45ade8495 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002144 May 05 13:47:05.808955 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:05.874097 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:05.966808 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.152208 May 05 13:47:05.974152 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Thu May 5 13:47:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 05 13:47:05.982260 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-35ea2f7f-31ea-43ae-9235-03a7114bcb8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:06.081614 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-35ea2f7f-31ea-43ae-9235-03a7114bcb8e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103510 May 05 13:47:06.082234 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Thu May 5 13:47:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:47:30.500365 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:30.501455 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 05 13:47:30.501849 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:30.559418 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-b8df1951-f5c1-40fc-9077-e7052b7c7402 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:30.577782 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-b8df1951-f5c1-40fc-9077-e7052b7c7402 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069752 May 05 13:47:30.578343 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Thu May 5 13:47:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:47:31.885752 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:31.886786 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-aa6e9d0e-4307-4f9c-8691-4e643a9bee9b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 05 13:47:31.887185 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:32.101174 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-6b660842-814f-4284-a20a-2197bb4ffe5a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:32.106866 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.wsgi [None req-6b660842-814f-4284-a20a-2197bb4ffe5a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 05 13:47:32.107429 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-6b660842-814f-4284-a20a-2197bb4ffe5a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:32.108219 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-6b660842-814f-4284-a20a-2197bb4ffe5a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058007 May 05 13:47:32.108735 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu May 5 13:47:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:32.117745 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-fca48281-d15e-4854-9c04-a54fd8d73def admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:32.139359 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-fca48281-d15e-4854-9c04-a54fd8d73def admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025146 May 05 13:47:32.139889 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:32.148979 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-dbceff85-c572-4c74-b381-7f13617b0bcb admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:32.170239 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-dbceff85-c572-4c74-b381-7f13617b0bcb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024660 May 05 13:47:32.170771 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:32.179771 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-fc0f365c-dfb2-48eb-b925-0ee06f08ff42 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:32.185716 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.wsgi [None req-fc0f365c-dfb2-48eb-b925-0ee06f08ff42 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 05 13:47:32.186309 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-fc0f365c-dfb2-48eb-b925-0ee06f08ff42 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:32.187087 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-fc0f365c-dfb2-48eb-b925-0ee06f08ff42 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010776 May 05 13:47:32.187575 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu May 5 13:47:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:33.413827 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-dbceff85-c572-4c74-b381-7f13617b0bcb admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:33.414891 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-dbceff85-c572-4c74-b381-7f13617b0bcb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 05 13:47:33.415264 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:33.606865 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-0f8dfa3d-f6b9-44d8-aa0a-a1f562b36f78 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:33.613363 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.wsgi [None req-0f8dfa3d-f6b9-44d8-aa0a-a1f562b36f78 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 05 13:47:33.614116 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-0f8dfa3d-f6b9-44d8-aa0a-a1f562b36f78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:33.615090 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-0f8dfa3d-f6b9-44d8-aa0a-a1f562b36f78 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063110 May 05 13:47:33.615884 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu May 5 13:47:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:33.625291 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-76b6eb79-ecd0-4f89-913e-9eba61709893 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:33.642505 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-76b6eb79-ecd0-4f89-913e-9eba61709893 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020754 May 05 13:47:33.643290 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:33.653559 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-de39fab7-2f54-4d62-930d-28847048cd8b admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:33.668511 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-de39fab7-2f54-4d62-930d-28847048cd8b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018884 May 05 13:47:33.670054 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:33.678878 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-6fb6bbb1-782e-4e0e-9786-f6e090f37123 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:33.684824 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.wsgi [None req-6fb6bbb1-782e-4e0e-9786-f6e090f37123 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 05 13:47:33.685413 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-6fb6bbb1-782e-4e0e-9786-f6e090f37123 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:33.686248 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-6fb6bbb1-782e-4e0e-9786-f6e090f37123 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011379 May 05 13:47:33.686748 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu May 5 13:47:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:34.897736 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-de39fab7-2f54-4d62-930d-28847048cd8b admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:34.898770 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-de39fab7-2f54-4d62-930d-28847048cd8b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 05 13:47:34.899166 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:35.085290 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-65164937-0268-4d41-a9a4-00022448666f admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:35.092299 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.wsgi [None req-65164937-0268-4d41-a9a4-00022448666f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 05 13:47:35.092867 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-65164937-0268-4d41-a9a4-00022448666f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:35.093695 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-65164937-0268-4d41-a9a4-00022448666f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058161 May 05 13:47:35.094241 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:47:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:35.103365 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-97bf1965-01ba-46e9-a2e7-c89879d24896 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:35.117476 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-97bf1965-01ba-46e9-a2e7-c89879d24896 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017649 May 05 13:47:35.117940 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:35.127716 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:35.141446 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017260 May 05 13:47:35.141957 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu May 5 13:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:47:35.150775 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-cd63a60f-61ef-445c-8618-b2918cd4f415 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:35.155889 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.wsgi [None req-cd63a60f-61ef-445c-8618-b2918cd4f415 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 05 13:47:35.156445 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-cd63a60f-61ef-445c-8618-b2918cd4f415 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:47:35.157213 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-cd63a60f-61ef-445c-8618-b2918cd4f415 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009930 May 05 13:47:35.157697 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:47:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 05 13:47:36.377478 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:36.378509 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 05 13:47:36.378912 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:36.566640 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-17c4f325-4526-49f8-a292-e17b9dbdb576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:36.639573 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-17c4f325-4526-49f8-a292-e17b9dbdb576 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.124031 May 05 13:47:36.640025 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu May 5 13:47:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:37.862591 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:37.863596 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 05 13:47:37.863996 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:38.051597 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-6d7ea7d2-2248-4402-811f-63272606e842 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:38.136646 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-6d7ea7d2-2248-4402-811f-63272606e842 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.134536 May 05 13:47:38.137208 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu May 5 13:47:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:39.335615 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:39.336675 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 05 13:47:39.337070 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:39.524200 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-7b225731-5785-4825-b88c-59d8c7080cbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:39.642370 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-7b225731-5785-4825-b88c-59d8c7080cbd admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.168600 May 05 13:47:39.642907 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu May 5 13:47:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:40.839618 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:40.843273 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002616 May 05 13:47:40.843698 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:41.034218 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-1360a6e2-b770-469b-8a68-3740599501d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:47:41.142498 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-1360a6e2-b770-469b-8a68-3740599501d3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.161197 May 05 13:47:41.143039 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu May 5 13:47:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:47:42.347954 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:42.348947 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 05 13:47:42.349341 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:47:42.534993 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-dde5fe5a-d991-4b62-87f0-ca39020eba4b admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:47:42.557578 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-dde5fe5a-d991-4b62-87f0-ca39020eba4b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069735 May 05 13:47:42.557578 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu May 5 13:47:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:48:45.364784 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.365719 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-a402e09e-45ec-489c-b074-d727fb2bf71a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 05 13:48:45.366144 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:48:45.422145 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-136b809c-65ba-4afc-ba97-0b46d208af1c admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.440651 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-136b809c-65ba-4afc-ba97-0b46d208af1c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068859 May 05 13:48:45.441172 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:48:45.464079 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-4233a8e9-709f-468b-9a31-0e73e451e197 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.471499 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-4233a8e9-709f-468b-9a31-0e73e451e197 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012133 May 05 13:48:45.472011 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:48:45.483612 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-6d831483-85cf-44d5-aeb8-9f8199f1d4d1 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.491012 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-6d831483-85cf-44d5-aeb8-9f8199f1d4d1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010798 May 05 13:48:45.491582 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:48:45.502971 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-6d10fff8-e2f0-4451-a7fa-96402c599486 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.510436 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-6d10fff8-e2f0-4451-a7fa-96402c599486 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 May 05 13:48:45.510952 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:48:45.521555 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:48:45.529291 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011153 May 05 13:48:45.529787 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Thu May 5 13:48:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:50:32.814434 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-790eda5a-655c-4929-9310-403b27d94a3b tempest-verify_tempest_config-245582313 tempest-verify_tempest_config-245582313-project] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:50:32.816382 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-790eda5a-655c-4929-9310-403b27d94a3b tempest-verify_tempest_config-245582313 tempest-verify_tempest_config-245582313-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106989 May 05 13:50:32.816921 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1133 bytes} [Thu May 5 13:50:32 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:52:13.500729 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:13.501762 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 05 13:52:13.502200 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:52:13.756527 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:13.757702 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:52:13.757702 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:52:13.758932 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:13.759375 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:13.760161 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:13.760590 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:13.794034 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-12929ea8-7709-4a61-affe-3e1cff326e7e admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.149897 May 05 13:52:13.794604 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:52:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:52:15.054075 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:15.055109 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 05 13:52:15.055506 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:52:15.244327 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:15.245514 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:52:15.245514 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:52:15.246706 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:15.247207 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:15.248501 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:15.248919 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:15.268220 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-8e4b13c1-2353-4877-b8da-f7b334cdf251 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074295 May 05 13:52:15.268701 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 36/73] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:52:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:52:26.918734 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:26.919741 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 05 13:52:26.920138 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:52:27.110326 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:27.111505 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:52:27.111505 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:52:27.112687 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:27.113130 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:27.113922 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:27.114395 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:27.139414 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-e8c540d0-7795-4b5a-b327-680f8a61fead admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081032 May 05 13:52:27.139903 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:52:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:52:28.375813 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: DEBUG nova.api.openstack.wsgi [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] Calling method '>' {{(pid=109560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:28.376841 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: INFO nova.api.openstack.requestlog [None req-bb4741eb-01de-4a8e-a998-8d2d4b623b69 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 05 13:52:28.377235 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: [pid: 109560|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1074 bytes} [Thu May 5 13:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:52:28.564864 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG nova.api.openstack.wsgi [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] Calling method '>' {{(pid=109561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:52:28.566076 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 05 13:52:28.566076 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: warnings.warn(msg) May 05 13:52:28.567325 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:28.567766 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:28.568552 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:52:28.568978 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: DEBUG oslo_concurrency.lockutils [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:52:28.591658 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: INFO nova.api.openstack.requestlog [None req-18ca9d03-850c-4ba7-8a3a-fcd52d1bf18d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076811 May 05 13:52:28.592288 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: [pid: 109561|app: 0|req: 38/77] 10.222.0.26 () {60 vars in 1193 bytes} [Thu May 5 13:52:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:53:25.517332 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: Thu May 5 13:53:25 2022 - graceful shutdown triggered... May 05 13:53:25.517073 dv-cinder-737618-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 05 13:53:25.518427 dv-cinder-737618-3-iscsi devstack@n-api.service[109560]: Gracefully killing worker 1 (pid: 109560)... May 05 13:53:25.518862 dv-cinder-737618-3-iscsi devstack@n-api.service[109561]: Gracefully killing worker 2 (pid: 109561)... May 05 13:53:26.517731 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: worker 1 buried after 1 seconds May 05 13:53:26.517731 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: worker 2 buried after 1 seconds May 05 13:53:26.517731 dv-cinder-737618-3-iscsi devstack@n-api.service[109559]: goodbye to uWSGI. May 05 13:53:26.519281 dv-cinder-737618-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 05 13:53:26.519859 dv-cinder-737618-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 05 13:53:26.522625 dv-cinder-737618-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 05 13:53:26.540352 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 5 13:53:26 2022] *** May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: nodename: dv-cinder-737618-3-iscsi May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: machine: x86_64 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: clock source: unix May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: pcre jit disabled May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: detected number of CPU cores: 4 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: current working directory: / May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: detected binary path: /usr/bin/uwsgi-core May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: your processes number limit is 47680 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: your memory page size is 4096 bytes May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: detected max file descriptor number: 2048 May 05 13:53:26.562507 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: lock engine: pthread robust mutexes May 05 13:53:26.563721 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: thunder lock: enabled May 05 13:53:26.563721 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 05 13:53:26.563721 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 05 13:53:26.625156 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: Python main interpreter initialized at 0x55cc9878b9c0 May 05 13:53:26.625156 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: python threads support enabled May 05 13:53:26.625156 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: your server socket listen backlog is limited to 100 connections May 05 13:53:26.625156 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: your mercy for graceful operations on workers is 90 seconds May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: mapped 403077 bytes (393 KB) for 2 cores May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: *** Operational MODE: preforking *** May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: *** uWSGI is running in multiple interpreter mode *** May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: spawned uWSGI master process (pid: 123913) May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: spawned uWSGI worker 1 (pid: 123930, cores: 1) May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: spawned uWSGI worker 2 (pid: 123931, cores: 1) May 05 13:53:26.635266 dv-cinder-737618-3-iscsi devstack@n-api.service[123913]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 05 13:53:26.626107 dv-cinder-737618-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 05 13:53:27.862226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 05 13:53:27.863766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 05 13:53:28.663346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:53:28.663346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: from cryptography.utils import int_from_bytes May 05 13:53:28.663673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:53:28.663673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: from cryptography.utils import int_from_bytes May 05 13:53:28.671142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:53:28.671142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: from cryptography.utils import int_from_bytes May 05 13:53:28.671480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 05 13:53:28.671480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: from cryptography.utils import int_from_bytes May 05 13:53:31.090421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:53:31.090997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:53:31.091299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:53:31.091599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:53:31.091865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:53:31.092266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.092603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.092936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.093271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.093616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-3-iscsi {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.097773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.098139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.099947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.100113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.100489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.100898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.101098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.101494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.101857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.102262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.102465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.102839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.103124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.103799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-3-iscsi {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.103799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.104185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.104466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.104915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.105753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.106071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.106609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.107117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.107618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.108126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.108619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.109127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.109626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.110153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.110631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.111111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.112178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.112671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.113160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.113432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.113763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.114134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.114482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.114824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.115091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.115356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.115693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.116032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.116353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.116842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.117171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.117500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.117819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.118164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.118488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.118810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.119147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.119479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.119818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.120141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.120477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.121473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.121739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.122089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.122455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.122793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.123117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.123453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.123785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.124108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.124433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.124755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.125090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.125442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.125765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.126059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.126385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.126712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.127044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.127366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.127686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.128007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.128321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.128642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.128742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 05 13:53:31.129131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.129231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 05 13:53:31.129331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.129508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 05 13:53:31.129611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.129874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.129977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 05 13:53:31.130183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 05 13:53:31.130286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.130524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.130624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.130848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.130941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.131933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.132991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.133970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-3-iscsi {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.134803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.135985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.136969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.137928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.138980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.139926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-3-iscsi {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.140905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.141901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.142137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.142269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.142566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.142904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.143100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.143266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.143574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.143983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.144146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.144320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.144466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.144620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.144764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.144910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.145061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.145220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.145220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.145510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.145660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.145810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.145961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.146160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.146315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.146468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.146621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.146775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.146931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.147080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.147224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.147366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.147510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.147652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.147808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.147953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.148105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.148248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.148391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.148539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.148695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.148849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.148992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.149143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.149286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.149476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.149633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.149795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.149940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.150113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.150266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.150418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.150570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.150714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.150863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.151012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.151163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.151163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.151444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.151587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.151747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.151891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.152047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.152197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.152417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.152564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.152861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.153171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.153334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.153488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.153866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.154284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.154439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.154439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.154746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.154746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.155021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.155164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.155314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.155473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.155632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.155784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.155928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.156080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.156233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.156407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.156559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.156703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.156852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.157144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.157311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.157465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.157615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.157767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.157920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.158093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.158261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.158416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.158577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.158775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.159075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.159228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.159388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.159540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.159693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.159844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.159994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.160148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.160303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.160454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.160598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.160752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.160905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.161059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.161349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.161510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.161655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.161798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.161951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.162134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.162288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.162439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.162582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.162726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.163029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.163344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.163498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.163642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.163985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.164246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.164600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.164804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.164970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.165122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.165283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.165448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.165607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.165770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.165928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.166114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.166283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.166435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.166592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.166749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.166980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.167220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.167386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.168039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.168193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.168349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.168500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.168653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.168804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.168962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.169113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.169258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.169408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.169844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.170036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.170189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.170334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.170478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.170633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.170778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.171073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.171237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.171381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.171525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.171669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.171811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.171963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.172118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.172263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.172406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.172548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.172711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.172868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.173307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.173476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.173623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.173774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.174106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.174370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.174643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.174803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.174955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.175099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.175324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.175489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.175634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.175786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.175930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.176073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.176233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.176377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.176521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.176664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.176815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.176966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.177124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.177373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.177535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 05 13:53:31.177689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.177834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.177997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.178985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.179933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.180097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.180821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.180980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.181936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.182346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.182514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.182673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.182825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.182985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.183986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.184315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.184599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.184875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.185842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.186964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.187115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.187115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.187524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.187683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.187843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.188838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.189960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.190961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.191110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.191268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.191498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.191680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.191846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.192950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.193101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.193276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.193595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.194149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.194494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.194769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.195669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.195842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.196967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.197132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.197291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.197453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.197696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.197855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.198895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.199842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.200976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.201930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.202886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.203962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.204274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.204483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.204714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.204972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.205146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.205306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.205468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.205627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.205777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.206253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.206572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.206764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.206918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.207943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.208884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.209034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.209190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.209445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.209700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.209879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.210867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.211978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.212903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.213943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.214119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.214446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.214611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.214855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.215929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.216877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.217828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.218931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.219875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.220964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.221904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.222869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.223908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.224066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.224066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.224381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.224694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.224875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.225999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.226985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.227915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.228929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.229873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.230570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.230700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.230800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.230903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.231933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.232967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.233949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.234963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.235925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.236960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.237981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.238972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.239892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.240976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.241908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.242975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.243942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.244944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.245878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.246833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.247813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.248981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.249091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.249350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.249460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.249671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.249768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.250989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.251941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.252916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.253976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.254966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.255926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.256863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.257887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.258877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.259863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.260845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.261001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.261179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.261901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.262927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.263997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.264955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.265991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.266858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.267834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.268799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269013 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.269973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.270977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.271939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.272991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.273954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.274968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.275187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.275294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.275509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.275650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.275924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.276936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.277886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.278865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.279799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.280973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.281924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.282928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.283933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.284898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.285974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.286960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.287936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.288148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.288245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.288464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.288574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.288786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.289780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.290995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.291269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.291367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.291600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.291717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.291931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.292034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.292249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.292348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.293872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.294888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.295859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.296857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.297785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.298996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.299968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.300946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.301913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.302900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.303924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.304912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.305844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.306832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.307989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.308106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.308395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.308587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.308723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.308948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.309956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.310967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.311920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.312961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.313910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.314942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.315838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.316798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.317974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.318963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.319927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.320895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.321983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.322229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.322433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.322553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.322777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.322913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.323109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.323244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.323440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.324281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.324395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.324611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.324723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.324938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.325918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.326917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.327990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.328969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.329932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.330183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.330284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.330507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.330614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.330830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.331187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.331416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.331514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.331763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.331867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.332838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.333807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.334813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.335779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.336894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.337876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.338890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.339936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.340933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.341885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.342130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.342353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.342453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.342718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.342822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.343845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.344960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.345999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.346983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.347941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.348864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.349852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.350858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.351799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.352977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.353949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.354080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.354300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.354407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.354615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.354712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.355456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.355616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.355792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.355889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.356853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.357975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.358123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.358353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.358453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.358690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.358797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.359783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.360999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.361985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.362992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.363962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.364069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.364217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:53:31.364315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.364595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.364926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.365282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.365617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.365950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.366326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.366660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.366988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.367313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.367637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.367961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.368294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.368639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.368968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.369297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.369733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.370081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.370420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.371300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.371629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.371968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.372306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.372634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.372974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.373301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.373645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.373998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.374377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.374719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.375042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.375362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.375680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.376006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.376339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.376663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.376984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.377300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.377626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.377946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.378287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.378607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.378926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.379256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.379574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.379891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.380209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.380526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.380842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.381159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.381482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.381798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.382143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.382467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.382786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.383103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.383512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.383793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.384165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.384469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.384792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.385127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.385455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.385795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.386163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.386524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.386853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.387201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.387528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.387859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.388186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.388513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.388696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_db.sqlalchemy.engines [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.388979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.389176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.389524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.389853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.390205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.390541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.390873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.391209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.391541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.391869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.392214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.392542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.392869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.393199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.393523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.393849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.394278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.394539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.394883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.395226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.395567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.395913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.396275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.396606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.396968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.397315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.397642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.397970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.398335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 05 13:53:31.398593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 05 13:53:31.422039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_db.sqlalchemy.engines [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.455226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.context [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8fe454e-7513-4ff7-93a5-967e7a71a07d(cell1) {{(pid=123931) load_cells /opt/stack/nova/nova/context.py:464}} May 05 13:53:31.459977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:53:31.461550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:53:31.462393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:53:31.464324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:53:31.476710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_db.sqlalchemy.engines [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.478179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_db.sqlalchemy.engines [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.489352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.context [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8fe454e-7513-4ff7-93a5-967e7a71a07d(cell1) {{(pid=123930) load_cells /opt/stack/nova/nova/context.py:464}} May 05 13:53:31.493769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:53:31.495396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:53:31.496744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:53:31.498733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:53:31.509737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_db.sqlalchemy.engines [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.511067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_db.sqlalchemy.engines [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.643785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_db.sqlalchemy.engines [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.674559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_db.sqlalchemy.engines [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 05 13:53:31.991180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: WARNING keystonemiddleware.auth_token [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:53:31.997812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: WARNING keystonemiddleware.auth_token [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:53:32.002376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WARNING keystonemiddleware.auth_token [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:53:32.009050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WARNING keystonemiddleware.auth_token [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:53:32.361375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WARNING keystonemiddleware.auth_token [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:53:32.366596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WARNING keystonemiddleware.auth_token [None req-077b638e-58a9-4d70-ae5f-be56c38bffd2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:53:32.372064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc9878b9c0 pid: 123930 (default app) May 05 13:53:32.372565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: WARNING keystonemiddleware.auth_token [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 05 13:53:32.377700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: WARNING keystonemiddleware.auth_token [None req-f1607fb6-b964-4da4-b3f2-f0e7ab5ad084 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 05 13:53:32.383132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cc9878b9c0 pid: 123931 (default app) May 05 13:54:15.896474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75197b35-d843-40b8-ab79-28c7f5ac9093 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Action: 'create', calling method: .version_select at 0x7fb4e9a163a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1248109640"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:16.165625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c9b939c8-1009-4c2d-848e-e6e338dab356 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Action: 'create', calling method: .version_select at 0x7fb4e9a163a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1251059195", "metadata": {"Type": "work"}}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:18.368440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75197b35-d843-40b8-ab79-28c7f5ac9093 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.669168 May 05 13:54:18.369980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1154 bytes} [Thu May 5 13:54:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 05 13:54:18.467841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c9b939c8-1009-4c2d-848e-e6e338dab356 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.682098 May 05 13:54:18.469307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Thu May 5 13:54:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3686 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 05 13:54:18.474888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5139dc1b-e005-4fd8-95f5-800212ad5520 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8ecaf70>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:18.628786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5139dc1b-e005-4fd8-95f5-800212ad5520 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 200 len: 345 microversion: 2.1 time: 0.158063 May 05 13:54:18.629409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:18 2022] GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:18.635556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-603977a5-3cfe-4d9d-85cb-84437a530c90 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8edb0d0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:18.772533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41647d8f-febc-4809-b5ff-3072a052dbb3 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Action: 'create', calling method: .version_select at 0x7fb4e8ec8ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-879386905", "metadata": {"Type": "work"}}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:18.774077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41647d8f-febc-4809-b5ff-3072a052dbb3 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:18.776007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41647d8f-febc-4809-b5ff-3072a052dbb3 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.403810 May 05 13:54:18.776575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 2/4] 10.222.0.26 () {60 vars in 1155 bytes} [Thu May 5 13:54:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 13:54:18.789825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b852ae9b-3ccb-4cdd-a5fb-99c62e104ec5 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Action: 'create', calling method: .version_select at 0x7fb4e8ec8dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-481518290", "metadata": {"Type": "work"}}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:18.791045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b852ae9b-3ccb-4cdd-a5fb-99c62e104ec5 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:18.792401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b852ae9b-3ccb-4cdd-a5fb-99c62e104ec5 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006536 May 05 13:54:18.792913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 3/5] 10.222.0.26 () {60 vars in 1155 bytes} [Thu May 5 13:54:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 13:54:18.809005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-de53ef6b-e9d2-4ada-be80-2fc048a4af5e tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Action: 'create', calling method: .version_select at 0x7fb4e8ee0d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1908396927", "metadata": {"Type": "work"}}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:18.811234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-de53ef6b-e9d2-4ada-be80-2fc048a4af5e tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:18.814864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-de53ef6b-e9d2-4ada-be80-2fc048a4af5e tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015592 May 05 13:54:18.821022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 4/6] 10.222.0.26 () {60 vars in 1155 bytes} [Thu May 5 13:54:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 13:54:18.826986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6ad067a-322f-4141-ba67-925138db83c8 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Calling method '.version_select at 0x7fb4e947e8b0>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:18.841261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-603977a5-3cfe-4d9d-85cb-84437a530c90 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 353 microversion: 2.1 time: 0.209791 May 05 13:54:18.842874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:18 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:18.897532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-d6ad067a-322f-4141-ba67-925138db83c8 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] HTTP exception thrown: Volume tempest-invalid-798867717 could not be found. May 05 13:54:18.898250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6ad067a-322f-4141-ba67-925138db83c8 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 404 to user: Volume tempest-invalid-798867717 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:18.899175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6ad067a-322f-4141-ba67-925138db83c8 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-798867717" status: 404 len: 98 microversion: 2.1 time: 0.076990 May 05 13:54:18.899835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1214 bytes} [Thu May 5 13:54:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-798867717 => generated 98 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 05 13:54:18.909538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-64a4ebfd-457d-46af-b336-1c9b93da4d89 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003794 May 05 13:54:18.918318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 4/9] 10.222.0.26 () {58 vars in 1139 bytes} [Thu May 5 13:54:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 05 13:54:18.919637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c8d9b0d9-a5b0-402c-a86c-06ee103149cb tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004303 May 05 13:54:18.920150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1136 bytes} [Thu May 5 13:54:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 05 13:54:18.931317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0d578cd7-0ff6-462e-9799-783942b29283 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Calling method '.version_select at 0x7fb4e8edb9d0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:19.117315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-0d578cd7-0ff6-462e-9799-783942b29283 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] HTTP exception thrown: Volume a134a81b-febe-443a-9201-471dc6d6fa4a could not be found. May 05 13:54:19.118761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0d578cd7-0ff6-462e-9799-783942b29283 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 404 to user: Volume a134a81b-febe-443a-9201-471dc6d6fa4a could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:19.121518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0d578cd7-0ff6-462e-9799-783942b29283 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/a134a81b-febe-443a-9201-471dc6d6fa4a" status: 404 len: 109 microversion: 2.1 time: 0.194720 May 05 13:54:19.122789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 5/11] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 13:54:18 2022] DELETE /compute/v2.1/os-volumes/a134a81b-febe-443a-9201-471dc6d6fa4a => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:19.135950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e7c61b0f-76a6-4fa4-a04b-5baef56f1d30 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Calling method '.version_select at 0x7fb4e9014c10>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:19.221511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-e7c61b0f-76a6-4fa4-a04b-5baef56f1d30 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] HTTP exception thrown: Volume 969b7fa4-0f4b-4c0d-9457-3a8fe58d01f2 could not be found. May 05 13:54:19.222653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e7c61b0f-76a6-4fa4-a04b-5baef56f1d30 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] Returning 404 to user: Volume 969b7fa4-0f4b-4c0d-9457-3a8fe58d01f2 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:19.223832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e7c61b0f-76a6-4fa4-a04b-5baef56f1d30 tempest-VolumesNegativeTest-1233394730 tempest-VolumesNegativeTest-1233394730-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/969b7fa4-0f4b-4c0d-9457-3a8fe58d01f2" status: 404 len: 109 microversion: 2.1 time: 0.093817 May 05 13:54:19.224631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:19 2022] GET /compute/v2.1/os-volumes/969b7fa4-0f4b-4c0d-9457-3a8fe58d01f2 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:19.641611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7381756a-19cb-4ace-bae1-a52f2cdfbbf3 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8edb700>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:19.747412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7381756a-19cb-4ace-bae1-a52f2cdfbbf3 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 200 len: 346 microversion: 2.1 time: 0.110130 May 05 13:54:19.749512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:19 2022] GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:19.760826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-81aed8b5-7781-45b3-b611-cb614d082e7b tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Action: 'create', calling method: .version_select at 0x7fb4e8edb0d0>, body: {"snapshot": {"volume_id": "0716e5cf-1631-42c1-8499-6c230f21572a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-89800730"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:19.880708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1768264474", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "networks": [{"uuid": "85cd36b2-8d8c-4138-8f76-9ea111b360e0"}]}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:20.084688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] validate_networks() for [('85cd36b2-8d8c-4138-8f76-9ea111b360e0', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:54:20.661554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-81aed8b5-7781-45b3-b611-cb614d082e7b tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.905726 May 05 13:54:20.662501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 7/14] 10.222.0.26 () {60 vars in 1161 bytes} [Thu May 5 13:54:19 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:20.679284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d3057724-66e3-493e-853b-ab71cf7f9bbf tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8edbaf0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:20.855383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d3057724-66e3-493e-853b-ab71cf7f9bbf tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 354 microversion: 2.1 time: 0.191626 May 05 13:54:20.856574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:20 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:20.862495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c3925024-1050-4b08-a112-f9f8814be509 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8edbb80>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:20.997632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c3925024-1050-4b08-a112-f9f8814be509 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 200 len: 285 microversion: 2.1 time: 0.139751 May 05 13:54:20.998230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:20 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:21.004244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4b4664ab-4015-40e0-a8e4-d10756ba89ea tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8e76670>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:21.138560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4b4664ab-4015-40e0-a8e4-d10756ba89ea tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 354 microversion: 2.1 time: 0.136127 May 05 13:54:21.138560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 10/17] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:20 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:21.142461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-040aa49a-f0a1-4c5a-bd31-e6fad68a324b tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8edb820>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:21.223630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-040aa49a-f0a1-4c5a-bd31-e6fad68a324b tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.085968 May 05 13:54:21.224484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 11/18] 10.222.0.26 () {58 vars in 1139 bytes} [Thu May 5 13:54:21 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:21.228933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9d7751c2-d97b-406f-9c0f-282481a8adfb tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8e769d0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:21.475064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9d7751c2-d97b-406f-9c0f-282481a8adfb tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 202 len: 0 microversion: 2.1 time: 0.249384 May 05 13:54:21.476237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 12/19] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 13:54:21 2022] DELETE /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:54:21.485003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ef24a891-a8c0-4c15-b16e-93aa97ad321c tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8e76160>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:21.543184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ef24a891-a8c0-4c15-b16e-93aa97ad321c tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 200 len: 285 microversion: 2.1 time: 0.064785 May 05 13:54:21.543864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 13/20] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:21 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 285 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:21.548779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa611598-0efe-4f58-b4c6-92934836d7e6 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8edb280>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:21.639482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa611598-0efe-4f58-b4c6-92934836d7e6 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 353 microversion: 2.1 time: 0.094295 May 05 13:54:21.640473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 14/21] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:21 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:21.860066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:54:21.861103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:54:21.861807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:54:21.862455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:54:21.863063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:54:21.889348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:21.890056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:21.891086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:21.891743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:21.960206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Getting quotas for project eb57f4c97b6a4f46ad3f1c129569ba8f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:21.977182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Getting quotas for user 4fc6b5e9c3ef4b6799795116f8e81b51 and project eb57f4c97b6a4f46ad3f1c129569ba8f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:22.015846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:54:22.019187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:54:22.264666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4b619c0-f724-4343-a4c0-2cd103822de9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.575562 May 05 13:54:22.265490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 8/22] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:54:22.276410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c5d7a8e4-a11a-439e-933d-849d6f690137 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:22.277787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c5d7a8e4-a11a-439e-933d-849d6f690137 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:22.570989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9cbc255f-d4e5-47db-9958-3586e6d56fe2 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8567c10>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:22.599498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c5d7a8e4-a11a-439e-933d-849d6f690137 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:22.631128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c5d7a8e4-a11a-439e-933d-849d6f690137 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1215 microversion: 2.1 time: 0.359005 May 05 13:54:22.640472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 15/23] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:22 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:22.643329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9cbc255f-d4e5-47db-9958-3586e6d56fe2 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 200 len: 285 microversion: 2.1 time: 0.085465 May 05 13:54:22.647931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 9/24] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:22 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:22.652394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a3e2de1f-863b-485e-9571-bda7d8a25dd0 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8edbdc0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:22.730266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a3e2de1f-863b-485e-9571-bda7d8a25dd0 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 353 microversion: 2.1 time: 0.082508 May 05 13:54:22.741668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 16/25] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:22 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:54:23.653980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1557c008-8b3a-491b-91bf-a6c9ce638bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:23.661561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ab74ffb-5d7f-4214-bc11-06e0ad0c46c3 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8e48670>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:23.665695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1557c008-8b3a-491b-91bf-a6c9ce638bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:23.709256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ab74ffb-5d7f-4214-bc11-06e0ad0c46c3 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 200 len: 285 microversion: 2.1 time: 0.053282 May 05 13:54:23.710032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 17/26] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:23 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:23.753995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6751494f-d9bc-4044-a9b6-5efbffe270f8 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e8e48d30>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:23.802635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1557c008-8b3a-491b-91bf-a6c9ce638bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:23.835659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1557c008-8b3a-491b-91bf-a6c9ce638bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1215 microversion: 2.1 time: 0.182853 May 05 13:54:23.847541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 10/27] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:23 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:23.876778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6751494f-d9bc-4044-a9b6-5efbffe270f8 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 200 len: 353 microversion: 2.1 time: 0.127773 May 05 13:54:23.877416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 18/28] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:23 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:24.713857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: .version_select at 0x7fb4e8567f70>, body: {"keypair": {"name": "tempest-keypair-1382990044"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:24.720307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bb978983-a6ef-4009-a28a-c7ec47db6645 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8e48b80>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:24.793749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bb978983-a6ef-4009-a28a-c7ec47db6645 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 200 len: 286 microversion: 2.1 time: 0.077018 May 05 13:54:24.794350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 19/29] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:24 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:54:24.804333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b171e620-0c66-470a-8816-4f47650eec97 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8e48430>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:24.819427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:24.833722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:25.013784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b171e620-0c66-470a-8816-4f47650eec97 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 202 len: 0 microversion: 2.1 time: 0.213119 May 05 13:54:25.014377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 20/30] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 13:54:24 2022] DELETE /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 05 13:54:25.019427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:25.020256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:25.037442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:25.038071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:25.039000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:25.045008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:25.245594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:25.262550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:25.283355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:25.297930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa6eabf3-086e-4315-a6b6-4d10d8e7ae79 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.181681 May 05 13:54:25.299264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 11/31] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 13:54:24 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:25.304636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e544d049-c9ae-41b3-aac7-6ed69d9d2c71 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1219 microversion: 2.1 time: 0.288979 May 05 13:54:25.312718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 21/32] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:25 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1219 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:25.324536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e5d9dd44-d1f0-4713-ab7c-14a402ecbe58 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Calling method '.version_select at 0x7fb4e854b3a0>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:25.329636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-90b4105f-e5ac-43b8-8172-4c602f891eb4 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8db9790>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:25.369566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-e5d9dd44-d1f0-4713-ab7c-14a402ecbe58 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] HTTP exception thrown: Volume 2fc3cd2e-cd93-4ce7-9559-602903fd58cb could not be found. May 05 13:54:25.370742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e5d9dd44-d1f0-4713-ab7c-14a402ecbe58 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] Returning 404 to user: Volume 2fc3cd2e-cd93-4ce7-9559-602903fd58cb could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:25.371781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e5d9dd44-d1f0-4713-ab7c-14a402ecbe58 tempest-VolumesGetTestJSON-64453990 tempest-VolumesGetTestJSON-64453990-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb" status: 404 len: 109 microversion: 2.1 time: 0.071224 May 05 13:54:25.372519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 12/33] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:25 2022] GET /compute/v2.1/os-volumes/2fc3cd2e-cd93-4ce7-9559-602903fd58cb => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:25.408547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-90b4105f-e5ac-43b8-8172-4c602f891eb4 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] HTTP exception thrown: Snapshot a26d1b0e-5b98-418b-a6e9-64df0e918ee1 could not be found. May 05 13:54:25.409237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-90b4105f-e5ac-43b8-8172-4c602f891eb4 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Returning 404 to user: Snapshot a26d1b0e-5b98-418b-a6e9-64df0e918ee1 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:25.410187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-90b4105f-e5ac-43b8-8172-4c602f891eb4 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1" status: 404 len: 111 microversion: 2.1 time: 0.096401 May 05 13:54:25.410740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 22/34] 10.222.0.26 () {58 vars in 1250 bytes} [Thu May 5 13:54:25 2022] GET /compute/v2.1/os-snapshots/a26d1b0e-5b98-418b-a6e9-64df0e918ee1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:25.425891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c04374d9-d6b3-4802-93bc-56a39b1152cc tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e855b040>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:25.691331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c04374d9-d6b3-4802-93bc-56a39b1152cc tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 202 len: 0 microversion: 2.1 time: 0.275310 May 05 13:54:25.692528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 13/35] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 13:54:25 2022] DELETE /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:54:25.701435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ad8da214-4bed-4edb-b347-6ef270927055 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8e48e50>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:25.843946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ad8da214-4bed-4edb-b347-6ef270927055 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 200 len: 345 microversion: 2.1 time: 0.147081 May 05 13:54:25.845338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 23/36] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:25 2022] GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:26.330480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:26.331108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:26.341413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:26.354277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:26.354277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:26.354277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:26.517139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:26.535836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d592b3fc-c3e4-4f7f-9033-92a569942e16 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1267 microversion: 2.1 time: 0.209572 May 05 13:54:26.538329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 24/37] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:26 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:26.685672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: .version_select at 0x7fb4e854b790>, body: {"keypair": {"name": "tempest-keypair-2017733230"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:26.716425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:26.728107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:26.857477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dd29d6b3-afc3-4aec-94a5-0f830df4b865 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8db9940>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:26.922330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-dd29d6b3-afc3-4aec-94a5-0f830df4b865 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] HTTP exception thrown: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. May 05 13:54:26.922934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dd29d6b3-afc3-4aec-94a5-0f830df4b865 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Returning 404 to user: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:26.923771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dd29d6b3-afc3-4aec-94a5-0f830df4b865 tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 404 len: 109 microversion: 2.1 time: 0.070985 May 05 13:54:26.932564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 25/38] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:26 2022] GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:26.938462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-502c00ba-1480-4142-8022-c8c86a3892ce tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8d74e50>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:27.014704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-502c00ba-1480-4142-8022-c8c86a3892ce tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] HTTP exception thrown: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. May 05 13:54:27.015357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-502c00ba-1480-4142-8022-c8c86a3892ce tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Returning 404 to user: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:27.016188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-502c00ba-1480-4142-8022-c8c86a3892ce tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 404 len: 109 microversion: 2.1 time: 0.082330 May 05 13:54:27.017384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 26/39] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 13:54:26 2022] DELETE /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:54:27.024948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56dff453-58b7-4bca-9683-d920b391267d tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Calling method '.version_select at 0x7fb4e8db9160>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:27.087183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-56dff453-58b7-4bca-9683-d920b391267d tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] HTTP exception thrown: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. May 05 13:54:27.088410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56dff453-58b7-4bca-9683-d920b391267d tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] Returning 404 to user: Volume 0716e5cf-1631-42c1-8499-6c230f21572a could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:54:27.089266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-56dff453-58b7-4bca-9683-d920b391267d tempest-VolumesSnapshotsTestJSON-1504108323 tempest-VolumesSnapshotsTestJSON-1504108323-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a" status: 404 len: 109 microversion: 2.1 time: 0.068316 May 05 13:54:27.089826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 27/40] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 13:54:27 2022] GET /compute/v2.1/os-volumes/0716e5cf-1631-42c1-8499-6c230f21572a => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 05 13:54:27.560522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:27.561155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:27.579440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:27.580701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:27.591224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:27.595041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:27.931748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:27.940861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b89a62f6-1419-419b-96fa-7e37d47535da tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1285 microversion: 2.1 time: 0.384825 May 05 13:54:27.945865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 28/41] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:27 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1285 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:28.090606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:28.110598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:28.138142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-075a419a-1424-42e7-b8cb-f7c2e06a2e0a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 2.076409 May 05 13:54:28.143463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 14/42] 10.222.0.26 () {62 vars in 1198 bytes} [Thu May 5 13:54:26 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 2087 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 05 13:54:28.966235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:28.967932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:28.981987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:28.984606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:28.986204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:28.989265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:29.096645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:29.103987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5f990c6c-42a0-47a3-a046-a7ba150cc7ca tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1273 microversion: 2.1 time: 0.144686 May 05 13:54:29.104773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 29/43] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:28 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:30.122218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:30.123579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:30.158249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:30.160063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:30.162828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:30.169230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:30.918250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:30.944005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2905ead6-c0b6-4247-97f2-d1de5d3b6b4d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.826196 May 05 13:54:30.951820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 15/44] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:30 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:30.993146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1857536175", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0b291d6-4191-476b-9202-167169caeaa6"}], "security_groups": [{"name": "tempest-securitygroup--406325605"}], "key_name": "tempest-keypair-1382990044", "user_data": "}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:31.320910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] validate_networks() for [('e0b291d6-4191-476b-9202-167169caeaa6', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:54:31.977227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:31.980476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:32.000614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:32.006583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:32.006583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:32.006583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:33.223081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:33.231466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e5839af-aa7f-4637-9a9e-a13adbfed5bd tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 1.263543 May 05 13:54:33.241513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 16/45] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:31 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:34.250444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:34.251189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:34.263528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.263988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.264906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.265354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.622853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:34.633193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ae72b82a-1ac9-4875-9f5b-d0a37030e3cc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.387224 May 05 13:54:34.636181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 17/46] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:34 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:34.657527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:54:34.658524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:54:34.659164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:54:34.659716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:54:34.660266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:54:34.692903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.693356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.694189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.694623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.745884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:34.754197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:34.772370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:54:34.775907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:54:34.926523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-de665b3f-94d5-4cee-9039-5ce2d5342358 req-967479bc-d256-4f98-8449-a721f43bf38f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52755510-f33b-4ad1-a9ae-bda959b86c66", "tag": "bdad3e61-bd9e-440f-8067-30fa3eda7b27"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:34.946512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-de665b3f-94d5-4cee-9039-5ce2d5342358 req-967479bc-d256-4f98-8449-a721f43bf38f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.947264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-de665b3f-94d5-4cee-9039-5ce2d5342358 req-967479bc-d256-4f98-8449-a721f43bf38f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.972601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-de665b3f-94d5-4cee-9039-5ce2d5342358 req-967479bc-d256-4f98-8449-a721f43bf38f service nova] Creating event network-changed:bdad3e61-bd9e-440f-8067-30fa3eda7b27 for instance 52755510-f33b-4ad1-a9ae-bda959b86c66 on hv-cinder-73761 May 05 13:54:34.973420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-de665b3f-94d5-4cee-9039-5ce2d5342358 req-967479bc-d256-4f98-8449-a721f43bf38f service nova] Acquired lock "compute-rpcapi-router" {{(pid=123930) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 05 13:54:34.974973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.975748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.976768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:34.977375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:34.987527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.compute.rpcapi [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 05 13:54:34.988845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] Releasing lock "compute-rpcapi-router" {{(pid=123930) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 05 13:54:35.022732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dcf8c859-ad93-4a97-afa9-15f5f4199a42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.035002 May 05 13:54:35.023620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 30/47] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:54:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 4037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:54:35.036428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b46ebeab-60ba-4ff1-b164-bb33f0ae7e09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:35.037493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b46ebeab-60ba-4ff1-b164-bb33f0ae7e09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:35.043731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed263217-0a43-451f-8b50-ee35647d5a4a None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299253 May 05 13:54:35.048531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 18/48] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:54:35.219092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b46ebeab-60ba-4ff1-b164-bb33f0ae7e09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:35.229596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b46ebeab-60ba-4ff1-b164-bb33f0ae7e09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1238 microversion: 2.1 time: 0.197297 May 05 13:54:35.231310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 31/49] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:35 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1238 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:35.590796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1128906430", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8df3eb2-04a6-4bb2-b7d0-c50b1c1096b0"}], "security_groups": [{"name": "tempest-securitygroup--1514616868"}], "key_name": "tempest-keypair-2017733230", "user_data": "}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:35.653857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:35.654808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:35.670307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:35.670895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:35.673293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:35.673399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:35.836110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] validate_networks() for [('b8df3eb2-04a6-4bb2-b7d0-c50b1c1096b0', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:54:35.900094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:35.911134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0c60288b-8019-45f1-a283-623e131ea629 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.263659 May 05 13:54:35.925183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 32/50] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:35 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:36.259602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f4ff9007-69cb-4fc4-bc38-0260fd082f9b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:36.260236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f4ff9007-69cb-4fc4-bc38-0260fd082f9b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:36.465867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f4ff9007-69cb-4fc4-bc38-0260fd082f9b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:36.472938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f4ff9007-69cb-4fc4-bc38-0260fd082f9b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1238 microversion: 2.1 time: 0.217861 May 05 13:54:36.473612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 33/51] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:36 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1238 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:36.572783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:54:36.573466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:54:36.574207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:54:36.575080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:54:36.576434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:54:36.592072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:36.595141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:36.595141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:36.595141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:36.641982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:54:36.646436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:54:36.672342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:54:36.675727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:54:36.883190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-233fb31a-63ae-4564-babf-49c0e9ee4b32 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.297370 May 05 13:54:36.883190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 19/52] 10.222.0.26 () {62 vars in 1187 bytes} [Thu May 5 13:54:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 05 13:54:36.893467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:36.894232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:36.935444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:36.936340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:36.975216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:36.976211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:36.977289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:36.977879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:37.013259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:37.022372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:37.034990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:37.048919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e00842a1-ccac-4761-8fb2-07931f410542 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1282 microversion: 2.20 time: 0.147949 May 05 13:54:37.048919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 34/53] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:36 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:37.243881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:37.243881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-98db389f-376b-4b6c-8ba4-aacfa6c5310d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.303744 May 05 13:54:37.243881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 20/54] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:36 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:37.491688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:37.492336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:37.500326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:37.501133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:37.502178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:37.503180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:37.839644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:37.852098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4c33b264-c832-4ab6-b844-891881136197 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1242 microversion: 2.1 time: 0.365114 May 05 13:54:37.852710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 35/55] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:37 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1242 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:38.058992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:38.060954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:38.252567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:38.253538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:38.260849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:38.277906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:38.281006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:38.284392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:38.287056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:38.296397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:38.308434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:38.316062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b69a1cd0-0c5c-4f9d-aa94-c9afa5f17c8c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1282 microversion: 2.20 time: 0.258331 May 05 13:54:38.317907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 21/56] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:38 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:38.859266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:38.868664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:38.869293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:38.875879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b2380e8d-567d-4827-89b0-123b0a373af5 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.628883 May 05 13:54:38.877214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 36/57] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:38 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:38.880326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:38.880777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:38.881721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:38.882420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:39.174950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:39.183985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b0258f2-abea-4dea-afe1-b15cc7ebe479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1290 microversion: 2.1 time: 0.319066 May 05 13:54:39.195622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 22/58] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:38 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1290 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:39.337704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:39.339386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:39.347279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:39.348089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:39.349045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:39.349488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:39.455584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:39.475426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:39.478375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:39.481676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-771383ef-a76f-498f-aec0-8e8ef508fa75 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1286 microversion: 2.20 time: 0.147292 May 05 13:54:39.483333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 37/59] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:39 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:39.896265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:39.897148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:39.909115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:39.909872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:39.924484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:39.925136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:40.212545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:40.213561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:40.225623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:40.229831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:40.232152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:40.233459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:40.365487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:40.374380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:40.383499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d9b2bb1a-546e-4c13-822f-1cd1b2119f92 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.493166 May 05 13:54:40.396567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 23/60] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:39 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:40.399746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b84e5d34-f6bd-4ed2-95c6-63c5aa205a14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1298 microversion: 2.1 time: 0.200755 May 05 13:54:40.401111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 38/61] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:40 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1298 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:40.507172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:40.508354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:40.520730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:40.521539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:40.524390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:40.527546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:40.770508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:40.784377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:40.788724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:40.793003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-96b1adb6-2071-4faa-966d-ac6a02b714fb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1334 microversion: 2.20 time: 0.295320 May 05 13:54:40.814057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 24/62] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:40 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1334 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:41.404326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:41.405042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:41.413757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.414517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:41.417749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:41.418416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:41.426538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.427399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:41.429189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.430796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:41.439283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.440199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:41.645551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:41.656421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-27355ff5-2adf-4534-b935-c0d44f3be753 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1296 microversion: 2.1 time: 0.242061 May 05 13:54:41.658224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 25/63] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:41 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1296 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:41.780926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:41.792977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4bb1ed43-bd30-404d-9eaf-abf8f596dde0 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.392617 May 05 13:54:41.794968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 39/64] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:41 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:41.813382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:41.815538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:41.833115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.835917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:41.839349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:41.840080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:42.028153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:42.036928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:42.038471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:42.043751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0f061be1-8dc0-4159-ab07-a13158a74efb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1334 microversion: 2.20 time: 0.234835 May 05 13:54:42.054548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 26/65] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:41 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1334 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:42.675296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:42.675863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:42.682519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:42.682973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:42.683741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:42.684183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:42.815487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:42.816103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:42.822711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:42.823164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:42.823940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:42.824378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:42.927673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:42.941910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-88a0ae02-353e-45e7-8092-d8f1b7336dc1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.265421 May 05 13:54:42.944315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 40/66] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:42 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:43.023917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:43.031844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-48276b2f-2904-4dc4-bd48-60b5c1371508 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.220206 May 05 13:54:43.032884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 27/67] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:42 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:43.064676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:43.065576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:43.075053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:43.075512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:43.076652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:43.077099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:43.165111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:43.176759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:43.178567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:43.180096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6b68b81-fa1a-4b69-b81b-f0ff70d7ce97 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1352 microversion: 2.20 time: 0.119460 May 05 13:54:43.182129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 41/68] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:43 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:54:43.962809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:43.963843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:43.973488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:43.973955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:43.975440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:43.975941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:44.052389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:44.057256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:44.064102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:44.064560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:44.065357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:44.068413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:44.534390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:44.550061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:44.561092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec7b6a2c-718b-4554-96cb-bdf8a72a5072 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.604318 May 05 13:54:44.563925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-60c6e5a2-94ab-435d-81e0-a6e6c555e11d tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.516666 May 05 13:54:44.570008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 42/69] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:44 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:44.573618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 28/70] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:43 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:44.581915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:44.584394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:44.604893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:44.610487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:44.611620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:44.612086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:45.031437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:45.043244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:45.044568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:45.045701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a2d03929-a5ef-451f-88ec-004f2743a4b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.474520 May 05 13:54:45.049278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 43/71] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:44 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:45.582257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:45.593790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:45.598742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:45.599588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:45.603834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:45.605738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:45.606852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:45.607420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:45.608766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:45.609069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:45.609722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:45.621756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.070109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:46.078568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-492953b4-7ebd-4268-8046-062f499f5bcc tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.501071 May 05 13:54:46.079755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 29/72] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:45 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:46.110172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:46.120266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-47cc30bb-bcce-40b9-a588-224bafcf16b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.530796 May 05 13:54:46.121343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 44/73] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:45 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:46.127208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-3bdcc118-0987-421a-b0c0-183c311ea4fa req-2f15d74a-1fc0-4eda-9351-542843a0f650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:46.146796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-3bdcc118-0987-421a-b0c0-183c311ea4fa req-2f15d74a-1fc0-4eda-9351-542843a0f650 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.147248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-3bdcc118-0987-421a-b0c0-183c311ea4fa req-2f15d74a-1fc0-4eda-9351-542843a0f650 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.167466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-3bdcc118-0987-421a-b0c0-183c311ea4fa req-2f15d74a-1fc0-4eda-9351-542843a0f650 service nova] Creating event network-changed:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:54:46.167994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-3bdcc118-0987-421a-b0c0-183c311ea4fa req-2f15d74a-1fc0-4eda-9351-542843a0f650 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 05 13:54:46.169091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.169525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.170324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.170748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.183236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.compute.rpcapi [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 05 13:54:46.184123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] Releasing lock "compute-rpcapi-router" {{(pid=123931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 05 13:54:46.204050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-019379dc-fa9c-42b3-b43d-97c7574ca9ce None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080931 May 05 13:54:46.205972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 45/74] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:46.213041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:46.214191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:46.226340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.226792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.228494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.229087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.271291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-8a83080b-ad75-4411-9723-f5623c34b354 req-2e9b9985-7a4d-426f-af64-af539f06cb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09aa3778-4ca9-460b-a8b8-8ecb90e011d2", "tag": "ad02117d-5482-4c80-9eec-a65489232708"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:46.284828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8a83080b-ad75-4411-9723-f5623c34b354 req-2e9b9985-7a4d-426f-af64-af539f06cb7f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:46.288184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8a83080b-ad75-4411-9723-f5623c34b354 req-2e9b9985-7a4d-426f-af64-af539f06cb7f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:46.305339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-8a83080b-ad75-4411-9723-f5623c34b354 req-2e9b9985-7a4d-426f-af64-af539f06cb7f service nova] Creating event network-changed:ad02117d-5482-4c80-9eec-a65489232708 for instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 on hv-cinder-73761 May 05 13:54:46.311714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-8a83080b-ad75-4411-9723-f5623c34b354 req-2e9b9985-7a4d-426f-af64-af539f06cb7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230574 May 05 13:54:46.312967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 30/75] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:46.450303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:46.458905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:46.460544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:46.461664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3d6240d0-3fab-4993-bf20-a76b180a745b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.254161 May 05 13:54:46.462280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 46/76] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:46 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:47.096833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:47.097550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:47.104526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.104976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.105930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.106565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.138940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:47.139810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:47.148052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.149207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.150995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.151454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.619286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:47.625580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:47.627088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ecee1f7-039c-404d-a941-7ef96d75c242 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.534642 May 05 13:54:47.627822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 31/77] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:47 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:47.632558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:47.633166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:47.633428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-274f32ee-8f4f-43aa-874d-b4190ad5d1fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.500291 May 05 13:54:47.634244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 47/78] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:47 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:47.639237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.639683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.640443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:47.640876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:47.777285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:47.785320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:47.786937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:47.788154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-407efce7-a844-400a-b6d4-ac52d2ce5740 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.159392 May 05 13:54:47.788722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 32/79] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:47 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:48.643616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:48.644337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:48.651181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.651636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.652413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.652852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.653205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:48.655046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:48.663556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.664270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.665598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.666255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.923154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:48.933837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a223f8e-c509-4481-bd84-06cb94a37792 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.293957 May 05 13:54:48.935930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 48/80] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:48 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:48.941660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:48.942298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:48.952956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.953628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.954968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:48.956146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:48.989952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:48.999539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6be6547-b357-4c19-8cf6-63e09e75f872 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.352799 May 05 13:54:49.009945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 33/81] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:48 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:49.101183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-f6839bb8-0920-4a81-b2d1-c9519096618d req-5b31c8cb-44d9-430d-9ac0-d7e50be1481e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52755510-f33b-4ad1-a9ae-bda959b86c66", "name": "network-vif-plugged", "status": "completed", "tag": "bdad3e61-bd9e-440f-8067-30fa3eda7b27"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:49.121607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f6839bb8-0920-4a81-b2d1-c9519096618d req-5b31c8cb-44d9-430d-9ac0-d7e50be1481e service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:49.122448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f6839bb8-0920-4a81-b2d1-c9519096618d req-5b31c8cb-44d9-430d-9ac0-d7e50be1481e service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:49.137212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-f6839bb8-0920-4a81-b2d1-c9519096618d req-5b31c8cb-44d9-430d-9ac0-d7e50be1481e service nova] Creating event network-vif-plugged:bdad3e61-bd9e-440f-8067-30fa3eda7b27 for instance 52755510-f33b-4ad1-a9ae-bda959b86c66 on hv-cinder-73761 May 05 13:54:49.143082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-f6839bb8-0920-4a81-b2d1-c9519096618d req-5b31c8cb-44d9-430d-9ac0-d7e50be1481e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141267 May 05 13:54:49.144237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 34/82] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:49.151942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:49.160482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:49.162142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:49.163253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d51c24e-3419-4000-960b-d29548afa7cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.226214 May 05 13:54:49.163818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 49/83] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:48 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:49.950950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:49.951703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:49.958244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:49.958707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:49.959544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:49.960022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:50.016586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:50.017206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:50.023890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:50.024346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:50.025577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:50.026056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:50.132128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:50.140424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3bc6307d-e428-4b06-8214-7fbb97250e2b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.193628 May 05 13:54:50.140995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 35/84] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:49 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:50.180552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:50.181165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:50.184794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:50.187106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:50.187502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:50.194241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:50.194241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:50.194461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ceae09bb-33a4-4fcd-a2a8-20b7004555b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.180044 May 05 13:54:50.194461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 50/85] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:50 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:50.317373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:50.326288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:50.327875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:50.329105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eeba02af-8796-495c-92c2-73f513db736e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.152384 May 05 13:54:50.329779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 36/86] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:50 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:54:51.157617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:51.158263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:51.164317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.164837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.166248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.166708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.210140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:51.211517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:51.218005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.218485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.219460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.219859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.353901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:51.364253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3be73aa7-642f-4373-8130-2fe65f378e9b tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.210258 May 05 13:54:51.367089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 51/87] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:51 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:51.381644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:51.382285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:51.383851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:51.388731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.389209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.389989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:51.390454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:51.392511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd7ec829-876a-44d6-8fb1-e3cee89b90fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.186482 May 05 13:54:51.393074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 37/88] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:51 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:54:51.521136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:51.534319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:51.535831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:51.536993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a2883409-b883-4ac6-a363-ba307bb16189 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.159195 May 05 13:54:51.537495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 52/89] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:51 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:52.036173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-83ad0f71-0331-4dd4-921a-77da243ab9fc req-ba0f23f4-1220-4023-90cb-e603a8278a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09aa3778-4ca9-460b-a8b8-8ecb90e011d2", "name": "network-vif-plugged", "status": "completed", "tag": "ad02117d-5482-4c80-9eec-a65489232708"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:52.045580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-83ad0f71-0331-4dd4-921a-77da243ab9fc req-ba0f23f4-1220-4023-90cb-e603a8278a34 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.046058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-83ad0f71-0331-4dd4-921a-77da243ab9fc req-ba0f23f4-1220-4023-90cb-e603a8278a34 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.058538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-83ad0f71-0331-4dd4-921a-77da243ab9fc req-ba0f23f4-1220-4023-90cb-e603a8278a34 service nova] Creating event network-vif-plugged:ad02117d-5482-4c80-9eec-a65489232708 for instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 on hv-cinder-73761 May 05 13:54:52.065776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-83ad0f71-0331-4dd4-921a-77da243ab9fc req-ba0f23f4-1220-4023-90cb-e603a8278a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 May 05 13:54:52.066522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 38/90] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:52.384448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:52.385072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:52.391142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.391599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.392373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.392819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.409914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:52.413506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:52.416808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.417328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.418211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.418723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.647096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:52.651777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:52.659210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67516256-67b9-4014-bfc6-96b3c1f52186 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.253426 May 05 13:54:52.659786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 39/91] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:52 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:52.661001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e45389a2-425f-433b-a2ca-fb6b0fc39b63 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.280853 May 05 13:54:52.661746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 53/92] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:52 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:52.665853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:52.666571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:52.673904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.674992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.675882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:52.676387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:52.839576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:52.851068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:52.854072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:52.858390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c1af038-7297-4f2d-b082-f4760d670548 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.194981 May 05 13:54:52.862442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 40/93] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:52 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:53.692950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:53.692950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:53.692950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:53.692950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:53.693796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:53.694251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:53.694251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:53.694476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:53.701434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:53.702366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:53.703650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:53.704704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:53.978118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:53.986406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3512dad0-e038-482c-9d38-c80293f19598 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1315 microversion: 2.1 time: 0.309612 May 05 13:54:53.986997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 54/94] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:53 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:54.000815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:54.010077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:54.010702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:54.015144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d9ff29c0-035f-45f9-8029-bd0ca0e77a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1363 microversion: 2.1 time: 0.332036 May 05 13:54:54.020851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 41/95] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:53 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:54.036255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:54.036965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:54.037963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:54.038870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:54.217702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:54.231641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:54.233139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:54.234285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-13972fff-d41e-400b-b65c-97bd90b8c112 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.241442 May 05 13:54:54.234846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 55/96] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:53 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:55.005779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:55.006611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:55.013818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.014374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.015341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.015957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.037067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:55.038995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:55.046535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.047384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.048602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.049286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.244195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:55.266288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-afef4cde-094a-4ecc-9275-c40c26c0e110 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1503 microversion: 2.1 time: 0.266127 May 05 13:54:55.267305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:55.268743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 42/97] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:54 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:55.275738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:55.276765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:55.282001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31cdf65e-d6b3-4a3e-9027-6bbb29f6cbb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1550 microversion: 2.1 time: 0.248685 May 05 13:54:55.285729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.286212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.287099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.287610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.294940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 56/98] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:54:55 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1550 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:54:55.303858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:55.303858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:55.307118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.308368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.311840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:55.313069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:55.495983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-33d1a901-c668-4671-8bf6-84debee3c24f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199484 May 05 13:54:55.497005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 57/99] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 13:54:55 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-interface => generated 285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:55.504533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:55.513416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:55.514966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:55.516093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-989a520c-644c-4a65-9644-18cf13e8ed74 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.246079 May 05 13:54:55.517807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 43/100] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:55 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:56.156419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-370a5438-f57e-419d-98f2-8760524c086a req-f5a3248f-ba9c-479b-b136-4f8f88e18572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "name": "network-vif-plugged", "status": "completed", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:56.164923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-370a5438-f57e-419d-98f2-8760524c086a req-f5a3248f-ba9c-479b-b136-4f8f88e18572 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:56.165892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-370a5438-f57e-419d-98f2-8760524c086a req-f5a3248f-ba9c-479b-b136-4f8f88e18572 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:56.176563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-370a5438-f57e-419d-98f2-8760524c086a req-f5a3248f-ba9c-479b-b136-4f8f88e18572 service nova] Creating event network-vif-plugged:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:54:56.182221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-370a5438-f57e-419d-98f2-8760524c086a req-f5a3248f-ba9c-479b-b136-4f8f88e18572 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031849 May 05 13:54:56.182857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 58/101] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:56.534560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:56.535285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:56.541873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:56.546608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:56.546608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:56.546608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:56.692039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:56.701562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:56.702072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:56.703206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-22ecf94f-b434-4eeb-be85-21fd64c1338a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.173375 May 05 13:54:56.703809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 44/102] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:56 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:57.141915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-c4fec0f3-bae0-4d82-9fd7-98589105ae12 req-2329dc1c-69fc-4317-ba63-9ccb323a7412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09aa3778-4ca9-460b-a8b8-8ecb90e011d2", "tag": "ad02117d-5482-4c80-9eec-a65489232708"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:57.160708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-c4fec0f3-bae0-4d82-9fd7-98589105ae12 req-2329dc1c-69fc-4317-ba63-9ccb323a7412 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:57.170831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-c4fec0f3-bae0-4d82-9fd7-98589105ae12 req-2329dc1c-69fc-4317-ba63-9ccb323a7412 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:57.174688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-c4fec0f3-bae0-4d82-9fd7-98589105ae12 req-2329dc1c-69fc-4317-ba63-9ccb323a7412 service nova] Creating event network-changed:ad02117d-5482-4c80-9eec-a65489232708 for instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 on hv-cinder-73761 May 05 13:54:57.179749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-c4fec0f3-bae0-4d82-9fd7-98589105ae12 req-2329dc1c-69fc-4317-ba63-9ccb323a7412 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044113 May 05 13:54:57.180368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 59/103] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:57.507087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2611962-fb2e-43d4-9963-f72f497eb00b"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:54:57.509242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:57.517961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:57.518589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:57.519703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:57.521090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:57.730419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:57.735884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:57.761016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:57.765774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:57.767009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:57.768438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:57.972181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:57.982215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:57.984278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:57.985653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-51bd2077-8bcb-46fd-ae1d-4c426af8a1a2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1408 microversion: 2.20 time: 0.266566 May 05 13:54:57.996461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 60/104] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:57 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:58.973664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-07e3e624-cdd4-4bea-b288-8fc34153c352 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "POST /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.473195 May 05 13:54:58.975266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 45/105] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:54:57 2022] POST /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66/os-volume_attachments => generated 194 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:54:59.005544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:59.006374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:59.019664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:59.020972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:59.023130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:59.024774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:59.227886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:59.247210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:59.247210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:54:59.247210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-04810ac5-0b09-4731-86f5-3a12f0d1f2af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1599 microversion: 2.20 time: 0.246632 May 05 13:54:59.259462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 61/106] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:54:58 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1599 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:54:59.267320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:54:59.273549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:54:59.284319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:59.284319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:59.284319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:54:59.284319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:54:59.409649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e55b35d-187f-476e-954c-ea096be53458 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146922 May 05 13:54:59.410417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 46/107] 10.222.0.26 () {60 vars in 1315 bytes} [Thu May 5 13:54:59 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:55:01.255674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-4ba00094-c2e4-46c7-a941-6e79144fc689 req-3d9f0585-77df-4b81-82c1-b091ad49a1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:01.271775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4ba00094-c2e4-46c7-a941-6e79144fc689 req-3d9f0585-77df-4b81-82c1-b091ad49a1a9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:01.277270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4ba00094-c2e4-46c7-a941-6e79144fc689 req-3d9f0585-77df-4b81-82c1-b091ad49a1a9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:01.295365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-4ba00094-c2e4-46c7-a941-6e79144fc689 req-3d9f0585-77df-4b81-82c1-b091ad49a1a9 service nova] Creating event network-changed:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:55:01.295365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-4ba00094-c2e4-46c7-a941-6e79144fc689 req-3d9f0585-77df-4b81-82c1-b091ad49a1a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042674 May 05 13:55:01.298330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 62/108] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:55:12.202417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:12.203333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:12.210600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:12.214960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:12.214960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:12.214960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:12.240507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:55:12.613878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9edc9819-97b6-42de-869c-47cc16ac4306 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 204 len: 0 microversion: 2.1 time: 0.415430 May 05 13:55:12.614542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 47/109] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:55:12 2022] DELETE /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:55:12.622951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:12.623655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:12.629756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:12.630086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:12.630860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:12.631374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:12.766528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:12.774415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-59ed9f8f-dc49-4ee6-bee0-9fd00129cf1a tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1555 microversion: 2.1 time: 0.155545 May 05 13:55:12.774975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 63/110] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:12 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:13.793691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:13.794680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:13.801848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:13.802329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:13.803092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:13.803526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:13.933261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:13.953010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f65623ad-183c-4f60-b6a0-32c7be48d7f9 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1555 microversion: 2.1 time: 0.152753 May 05 13:55:13.953010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 48/111] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:13 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:14.960193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:14.961267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:14.968062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:14.970896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:14.970896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:14.970896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:15.131350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:15.139622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-61697f18-6404-4bac-af1b-237001093938 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1555 microversion: 2.1 time: 0.184833 May 05 13:55:15.140188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 64/112] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:14 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:15.421427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-220f8954-313f-4954-8c51-c4d025d67c89 req-af3b43e6-19c0-4314-9f63-60b8d3dce8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52755510-f33b-4ad1-a9ae-bda959b86c66", "name": "network-vif-deleted", "tag": "bdad3e61-bd9e-440f-8067-30fa3eda7b27"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:15.430556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-220f8954-313f-4954-8c51-c4d025d67c89 req-af3b43e6-19c0-4314-9f63-60b8d3dce8b4 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:15.450044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-220f8954-313f-4954-8c51-c4d025d67c89 req-af3b43e6-19c0-4314-9f63-60b8d3dce8b4 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:15.450044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-220f8954-313f-4954-8c51-c4d025d67c89 req-af3b43e6-19c0-4314-9f63-60b8d3dce8b4 service nova] Creating event network-vif-deleted:bdad3e61-bd9e-440f-8067-30fa3eda7b27 for instance 52755510-f33b-4ad1-a9ae-bda959b86c66 on hv-cinder-73761 May 05 13:55:15.450044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-220f8954-313f-4954-8c51-c4d025d67c89 req-af3b43e6-19c0-4314-9f63-60b8d3dce8b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 May 05 13:55:15.450044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 49/113] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:16.159884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:16.163080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:16.177845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:16.178417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:16.179843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:16.180374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:16.255450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc6b5e9c3ef4b6799795116f8e81b51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb57f4c97b6a4f46ad3f1c129569ba8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:16.264779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-932dc4da-7047-4397-9072-8a5d572fdaf3 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 200 len: 1346 microversion: 2.1 time: 0.111144 May 05 13:55:16.265566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 65/114] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:16 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:17.300514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:17.302555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:17.323466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:17.324783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:17.325864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:17.327401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:17.372839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] HTTP exception thrown: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. May 05 13:55:17.373611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Returning 404 to user: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:55:17.374737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a9481ab3-33bb-4cf1-894d-3460e167ea85 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 404 len: 111 microversion: 2.1 time: 0.096439 May 05 13:55:17.379105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 50/115] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:17 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:55:17.559543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:17.560526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:17.568095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:17.568815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:17.569791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:17.570480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:17.585734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] HTTP exception thrown: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. May 05 13:55:17.587252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Returning 404 to user: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:55:17.588996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-de908308-b47d-425c-a097-2df73e42a069 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036936 May 05 13:55:17.589999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 66/116] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 13:55:17 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:55:19.156465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:19.157117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:19.168632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:19.169066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:19.170372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:19.172399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:19.219776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] HTTP exception thrown: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. May 05 13:55:19.220837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Returning 404 to user: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:55:19.222336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2212090c-9ba5-4428-b833-19b98da2b7c8 tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 404 len: 111 microversion: 2.1 time: 0.069598 May 05 13:55:19.223227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 51/117] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:55:19 2022] DELETE /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:55:19.231328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:19.231936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] [instance: 52755510-f33b-4ad1-a9ae-bda959b86c66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:19.239788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:19.248094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:19.249486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:19.257623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:19.280001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] HTTP exception thrown: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. May 05 13:55:19.280584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] Returning 404 to user: Instance 52755510-f33b-4ad1-a9ae-bda959b86c66 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:55:19.283207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e64c777-9725-4a42-a1c2-a22222d2c88e tempest-DeleteServersTestJSON-1076380705 tempest-DeleteServersTestJSON-1076380705-project] 10.222.0.26 "GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66" status: 404 len: 111 microversion: 2.1 time: 0.055879 May 05 13:55:19.283927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 67/118] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:19 2022] GET /compute/v2.1/servers/52755510-f33b-4ad1-a9ae-bda959b86c66 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:55:30.170972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-765842023", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:30.295012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] validate_networks() for None {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:55:31.039722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:55:31.044603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:55:31.044603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:55:31.044603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:55:31.044603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:55:31.051631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:31.052009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:31.053441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:31.054112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:31.096856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Getting quotas for project 13cfbe72dcc24c108503a3e3b304d435. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:55:31.101343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Getting quotas for user e81a6f59026d403f93ee29de20119da6 and project 13cfbe72dcc24c108503a3e3b304d435. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:55:31.114480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:55:31.119071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:55:31.308904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c199cbf9-44c9-49ef-b95c-9fec4b339496 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152355 May 05 13:55:31.311307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 52/119] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:55:31.323193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e7ebd83f-f2e0-4ea7-b893-e3885dff70e2 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:31.324555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e7ebd83f-f2e0-4ea7-b893-e3885dff70e2 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:31.704429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e7ebd83f-f2e0-4ea7-b893-e3885dff70e2 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:31.715129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e7ebd83f-f2e0-4ea7-b893-e3885dff70e2 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1214 microversion: 2.1 time: 0.396940 May 05 13:55:31.717637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 68/120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:31 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1214 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:32.736397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3f7cfc9d-5633-4b34-bd81-07fd7294d861 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:32.738127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3f7cfc9d-5633-4b34-bd81-07fd7294d861 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:32.867761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3f7cfc9d-5633-4b34-bd81-07fd7294d861 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:32.878266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3f7cfc9d-5633-4b34-bd81-07fd7294d861 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1214 microversion: 2.1 time: 0.147600 May 05 13:55:32.888171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 53/121] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:32 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:33.902472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:33.907443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:33.917279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:33.917967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:33.921567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:33.924699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:34.030511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:34.038193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f5db289-1fa0-4e67-9e7c-f8aab4661cff tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1266 microversion: 2.1 time: 0.145747 May 05 13:55:34.038756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 69/122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:33 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:35.057478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:35.058133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:35.066089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:35.067058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:35.068531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:35.069183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:35.258052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:35.267146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83ae2405-a983-44ab-bfc6-533315524141 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1272 microversion: 2.1 time: 0.214598 May 05 13:55:35.271502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 54/123] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:35 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:35.782370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Action: 'create', calling method: .version_select at 0x7fb4e8448310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1069373282"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:35.825568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for project a4ec75326b484292937db17eccee43f3. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:55:35.833158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for user df7b5849a9214c41ab39669aa1b62eac and project a4ec75326b484292937db17eccee43f3. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:55:36.289719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:36.290560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for project a4ec75326b484292937db17eccee43f3. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:55:36.291121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:36.295481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for user df7b5849a9214c41ab39669aa1b62eac and project a4ec75326b484292937db17eccee43f3. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:55:36.303975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:36.309202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:36.309202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:36.309202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:36.310977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ebb6dacc-bfe1-46fb-aea6-ebd5a7d7265b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.921393 May 05 13:55:36.312133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 70/124] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 13:55:35 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:36.414003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:36.424243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-70b24d0a-8dab-478b-8e42-0161115048af tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1272 microversion: 2.1 time: 0.139418 May 05 13:55:36.425939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 55/125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:36 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:37.440936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:37.441551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:37.452013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:37.452470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:37.453260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:37.453698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:37.515495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1541413595", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:37.579525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] validate_networks() for [('dbcaa95d-24fb-4fed-89d9-b1cc139d6854', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:55:37.720597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:37.734274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-10f8e7d8-cfe9-4b7b-857d-ed43bcd15751 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.297000 May 05 13:55:37.750723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 56/126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:37 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:38.046420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:55:38.046845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:55:38.047388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:55:38.047712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:55:38.048118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:55:38.066531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:38.066991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:38.067795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:38.068229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:38.088252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:55:38.095487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for user b10632cbf11b46b2b94afd5df59daa25 and project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:55:38.115141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:55:38.117893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:55:38.350349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c35898e2-5d93-43f2-b748-568b6fb39c9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.174794 May 05 13:55:38.351899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 71/127] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:55:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 05 13:55:38.362184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-df2eac1e-d18d-4c97-b8e1-1a52e4c15679 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:38.363141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-df2eac1e-d18d-4c97-b8e1-1a52e4c15679 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:38.515205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-df2eac1e-d18d-4c97-b8e1-1a52e4c15679 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:38.527517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-df2eac1e-d18d-4c97-b8e1-1a52e4c15679 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1222 microversion: 2.1 time: 0.169552 May 05 13:55:38.528034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 57/128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:38 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:38.604816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1769299040", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:38.677514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] validate_networks() for [('dbcaa95d-24fb-4fed-89d9-b1cc139d6854', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:55:38.753158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:38.753797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:38.778742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:38.783644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:38.787660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:38.788251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:39.401432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:39.413554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ceec0e67-b120-499a-9339-9bb1f64d9664 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.663774 May 05 13:55:39.413554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 58/129] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:38 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:39.667812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-3fbbc851-8078-4b8b-b1c2-897eedd58369 req-1a4dfd62-246e-41cf-9134-3550855e8f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83bbae3a-1536-4f97-8d64-c39a7b29cf48", "tag": "ce53e097-61ed-4abb-b0a4-3e1ebda71852"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:39.690373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-3fbbc851-8078-4b8b-b1c2-897eedd58369 req-1a4dfd62-246e-41cf-9134-3550855e8f98 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:39.691075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-3fbbc851-8078-4b8b-b1c2-897eedd58369 req-1a4dfd62-246e-41cf-9134-3550855e8f98 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:39.713408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-3fbbc851-8078-4b8b-b1c2-897eedd58369 req-1a4dfd62-246e-41cf-9134-3550855e8f98 service nova] Creating event network-changed:ce53e097-61ed-4abb-b0a4-3e1ebda71852 for instance 83bbae3a-1536-4f97-8d64-c39a7b29cf48 on hv-cinder-73761 May 05 13:55:39.756902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-3fbbc851-8078-4b8b-b1c2-897eedd58369 req-1a4dfd62-246e-41cf-9134-3550855e8f98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096243 May 05 13:55:39.761057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 59/130] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:40.151795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:55:40.153512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:55:40.154360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:55:40.154948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:55:40.155513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:55:40.181993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:40.182747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:40.183778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:40.184374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:40.231044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:55:40.241146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for user b10632cbf11b46b2b94afd5df59daa25 and project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:55:40.266438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:55:40.269169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:55:40.432105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:40.433688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:40.447574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:40.448678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:40.449698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:40.450454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:40.476706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ae48da8b-b00b-4799-b03d-5aeebf4db81b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.876973 May 05 13:55:40.477952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 72/131] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:55:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:55:40.496755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f3baecb1-665a-4163-8669-a857128739a6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:40.498224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f3baecb1-665a-4163-8669-a857128739a6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:40.677670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f3baecb1-665a-4163-8669-a857128739a6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:40.687719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f3baecb1-665a-4163-8669-a857128739a6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1222 microversion: 2.1 time: 0.200776 May 05 13:55:40.688678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 73/132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:40 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1222 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:40.828599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:40.838993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6bf8480-37fd-4d62-a4ff-5c16608e6495 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.410594 May 05 13:55:40.843878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 60/133] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:40 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:41.704728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:41.705248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:41.711636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:41.712403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:41.713369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:41.716372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:41.813153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:41.822838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c21c14a9-4029-4ac7-b8bf-b9df0ca2b9f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1226 microversion: 2.1 time: 0.120648 May 05 13:55:41.823513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 74/134] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:41 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:41.855966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:41.856686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:41.864116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:41.865504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:41.865672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:41.866301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:42.014553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:42.015329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:42.021860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:42.022343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:42.023136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:42.023557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:42.051329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d4d93ef8-e9ee-4b86-b0ff-381cac090b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/ips" status: 200 len: 146 microversion: 2.1 time: 0.040900 May 05 13:55:42.051912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 75/135] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 13:55:42 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:42.060822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:42.071278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8e4575db-4ae4-4bdc-8541-4fd31a9dd709 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.220579 May 05 13:55:42.071894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 61/136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:41 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:42.844068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:42.844068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:42.848114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:42.848567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:42.849351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:42.849791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:42.914089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:42.922123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa6a1e60-6ed2-4932-bf98-ae0569984d9b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1218 microversion: 2.1 time: 0.085708 May 05 13:55:42.922690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 76/137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:42 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:43.090784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:43.091398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:43.097841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:43.098318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:43.103683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:43.103683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:43.227251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:43.234666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6e55a672-513e-4258-8e96-b3a8a9930b4c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.148356 May 05 13:55:43.235214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 62/138] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:43 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:43.939288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:43.939902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:43.945949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:43.946427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:43.947688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:43.948202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:44.011532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:44.018835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1c4af9c0-6264-4af1-9d00-51ef89b56a11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1218 microversion: 2.1 time: 0.083407 May 05 13:55:44.019408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 77/139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:43 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:44.251092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:44.251712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:44.258196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:44.258654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:44.260006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:44.260446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:44.388533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:44.395994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a57d1c51-4050-4d79-9752-709410b826c3 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.148686 May 05 13:55:44.396567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 63/140] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:44 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:44.988733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:44.989313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:44.995267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:44.996001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:44.996999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:44.997559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:45.043910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:45.044118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1a0d18ad-6d89-4b85-a647-825f531a1eb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/ips" status: 200 len: 151 microversion: 2.20 time: 0.059706 May 05 13:55:45.044543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:45.060142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 78/141] 10.222.0.26 () {60 vars in 1288 bytes} [Thu May 5 13:55:44 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:55:45.064238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:45.064994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:45.065930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:45.066414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:45.172728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:45.181325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a0a9d594-38c1-4b41-86ce-5648565aa07f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1274 microversion: 2.1 time: 0.149273 May 05 13:55:45.182030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 64/142] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:45 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:45.412765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:45.413400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:45.420203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:45.420660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:45.421481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:45.421922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:45.556789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:45.564211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c9b6b36-4480-4755-a5c8-e016b4c3a7ef tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.155363 May 05 13:55:45.564869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 79/143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:45 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:46.198351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:46.198969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:46.205401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:46.205851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:46.206931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:46.207374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:46.270765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:46.278200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2bc464d3-6e3f-4620-afdd-a9ece1cd9566 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1274 microversion: 2.1 time: 0.083566 May 05 13:55:46.278997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 65/144] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:46 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:46.582989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:46.583622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:46.590247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:46.590694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:46.591446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:46.591876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:46.718881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:46.726268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df2e5b44-99ff-402a-a517-bdd1b54c336a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.147360 May 05 13:55:46.726859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 80/145] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:46 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:47.295082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:47.295651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:47.302292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:47.302746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:47.304511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:47.304511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:47.365788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:47.373762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-831f3be7-fef1-4066-8886-bad6dffdeb65 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1274 microversion: 2.1 time: 0.082702 May 05 13:55:47.374367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 66/146] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:47 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:47.742975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:47.744208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:47.750090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:47.751688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:47.751688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:47.751889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:47.889956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:47.906608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-39e97850-b8ef-4c47-b108-c501c7e85611 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.167231 May 05 13:55:47.907315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 81/147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:47 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:48.367464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-f08cc1e7-2985-42ac-afc9-636443f0645f req-1e9f5efa-4416-44ff-9199-2eb6e350ad3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bbae3a-1536-4f97-8d64-c39a7b29cf48", "name": "network-vif-plugged", "status": "completed", "tag": "ce53e097-61ed-4abb-b0a4-3e1ebda71852"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:48.378067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f08cc1e7-2985-42ac-afc9-636443f0645f req-1e9f5efa-4416-44ff-9199-2eb6e350ad3d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:48.378513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f08cc1e7-2985-42ac-afc9-636443f0645f req-1e9f5efa-4416-44ff-9199-2eb6e350ad3d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:48.391868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-f08cc1e7-2985-42ac-afc9-636443f0645f req-1e9f5efa-4416-44ff-9199-2eb6e350ad3d service nova] Creating event network-vif-plugged:ce53e097-61ed-4abb-b0a4-3e1ebda71852 for instance 83bbae3a-1536-4f97-8d64-c39a7b29cf48 on hv-cinder-73761 May 05 13:55:48.392594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:48.393810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:48.399145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-f08cc1e7-2985-42ac-afc9-636443f0645f req-1e9f5efa-4416-44ff-9199-2eb6e350ad3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035856 May 05 13:55:48.400242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 67/148] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:48.411234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:48.411681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:48.412457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:48.430282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:48.557538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:48.572613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1da8808d-1837-4af2-b892-9ec88089b14b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1282 microversion: 2.1 time: 0.185754 May 05 13:55:48.574331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 82/149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:48 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:48.927827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:48.928529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:48.936643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:48.937800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:48.937974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:48.938592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.102470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7daf29de-c989-4f17-84ad-132dd8834c9f"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:49.108150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:49.120346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.121594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.121594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.122007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.223060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:49.231679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f9a7e774-47f9-462d-b841-f6d9e4498765 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.310566 May 05 13:55:49.235610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 68/150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:48 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:49.595492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:49.596532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:49.604117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.604608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.605460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.609860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.850790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:49.864262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa6f5b9d-3d2c-4742-84cf-1416a6b39ffc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.274930 May 05 13:55:49.865702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 69/151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:49 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:49.872002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:49.875975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:49.885276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.886530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.887530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:49.888165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:49.924968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lazy-loading 'flavor' on Instance uuid df2dfe03-fd03-4632-8c71-c9fcd83a94d7 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:55:50.626353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-595c2b77-c529-43b1-b1b6-cfc51d45c07f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.540057 May 05 13:55:50.628543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 83/152] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:55:49 2022] POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments => generated 194 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:55:50.636421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-0e582c08-8809-4d5e-a954-36f1e105037e req-0fda09e9-e01c-42ec-98dd-5523e706f668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d7ea7-2cac-4aa7-8904-084ff69b44e9", "tag": "44bcc933-613c-43d5-b972-9daca9d4c4d9"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:50.654151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-0e582c08-8809-4d5e-a954-36f1e105037e req-0fda09e9-e01c-42ec-98dd-5523e706f668 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:50.656421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-0e582c08-8809-4d5e-a954-36f1e105037e req-0fda09e9-e01c-42ec-98dd-5523e706f668 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:50.668975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05980c9b-09e6-43ce-855a-d7dee42e6f6f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/action" status: 202 len: 0 microversion: 2.20 time: 0.801657 May 05 13:55:50.669805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 70/153] 10.222.0.26 () {62 vars in 1318 bytes} [Thu May 5 13:55:49 2022] POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 05 13:55:50.674921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:50.678881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-0e582c08-8809-4d5e-a954-36f1e105037e req-0fda09e9-e01c-42ec-98dd-5523e706f668 service nova] Creating event network-changed:44bcc933-613c-43d5-b972-9daca9d4c4d9 for instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 on hv-cinder-73761 May 05 13:55:50.683677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:50.691184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-0e582c08-8809-4d5e-a954-36f1e105037e req-0fda09e9-e01c-42ec-98dd-5523e706f668 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062243 May 05 13:55:50.694469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 84/154] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:50.702674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:50.702674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:50.707182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:50.707650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:50.717455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:50.718588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:50.720226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:50.720725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:50.721612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:50.721955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:51.016164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:51.026583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:51.029572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:51.033830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bcce1606-2233-482b-8c98-158d7375243c tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1314 microversion: 2.1 time: 0.362840 May 05 13:55:51.034434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 71/155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:50 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:51.036224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:51.039317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-88ce256a-c190-4312-967f-3e962cd9df23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.343563 May 05 13:55:51.042907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:51.043703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 85/156] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:50 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:51.047836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:51.052137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-5ff28d04-95f2-4313-a203-a549fd1aab00 req-91052663-c461-4a46-ae57-084be05897be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c40e0507-c34b-4015-9186-c21ad9a69e72", "tag": "7614c088-27b6-400c-a06c-b3029502882a"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:51.059612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:51.061261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:51.065035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-5ff28d04-95f2-4313-a203-a549fd1aab00 req-91052663-c461-4a46-ae57-084be05897be service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:51.066310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:51.066553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:51.071983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-5ff28d04-95f2-4313-a203-a549fd1aab00 req-91052663-c461-4a46-ae57-084be05897be service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:51.083698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-5ff28d04-95f2-4313-a203-a549fd1aab00 req-91052663-c461-4a46-ae57-084be05897be service nova] Creating event network-changed:7614c088-27b6-400c-a06c-b3029502882a for instance c40e0507-c34b-4015-9186-c21ad9a69e72 on hv-cinder-73761 May 05 13:55:51.089339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-5ff28d04-95f2-4313-a203-a549fd1aab00 req-91052663-c461-4a46-ae57-084be05897be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044288 May 05 13:55:51.089938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 86/157] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:55:51.202081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:51.210307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9f4d92d1-5975-46f6-9819-d93e8822d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.172357 May 05 13:55:51.217762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 72/158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:51 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:52.051783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:52.052514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:52.058715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.059168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.059939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.060386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.062912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:52.063847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:52.074147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.074607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.075530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.075972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.243157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.250532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2216c19f-f848-4b15-b5e8-2b64184aa164 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1464 microversion: 2.1 time: 0.203419 May 05 13:55:52.251137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 87/159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:52 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:52.255800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:52.256870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:52.264388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.266041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.266731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.267383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.274255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.283545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.285879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.287609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-edb6a707-39f7-470d-a672-f261b6dcf88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.230317 May 05 13:55:52.288251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 73/160] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:52 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:52.293862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:52.294461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:52.300630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.301171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.302080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.302589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.329073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:55:52.423233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.433465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f0f47356-36ee-4977-82a2-199dc86a5da7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.181246 May 05 13:55:52.434205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 88/161] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:52 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:52.613013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-12eeaee8-efc3-42ca-8979-916436561797 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "DELETE /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 204 len: 0 microversion: 2.1 time: 0.323450 May 05 13:55:52.613613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 74/162] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:55:52 2022] DELETE /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:55:52.621618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:52.623743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:52.629757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.630223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.631058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:52.631493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:52.767795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:52.776107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fd6fb99a-bb03-4f68-a57b-e8d13341ca00 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1470 microversion: 2.1 time: 0.158235 May 05 13:55:52.776695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 89/163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:52 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:53.305480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:53.306613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:53.312955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.313397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.314184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.314616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.451700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:53.455903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:53.463309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.463994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.464861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.465515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.657548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:53.660826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:53.666177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:53.667671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:53.668829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d15416c-49e0-4a10-957c-d0987db850eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.367702 May 05 13:55:53.668945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b9bc8328-7ae0-46a4-8e62-a643c0bf66d0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.221211 May 05 13:55:53.669376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 75/164] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:53 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:53.669691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 90/165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:53 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:53.793978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:53.794625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:53.800901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.801352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.802178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:53.802619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:53.950128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:53.957876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-560c0151-5ad1-44c0-a9a3-a6d9716a989a tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1470 microversion: 2.1 time: 0.168259 May 05 13:55:53.958595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 76/166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:53 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:54.685308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:54.685858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:54.692370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.692860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:54.693674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.694190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:54.694528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:54.695202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:54.704194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.704648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:54.705437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.705887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:54.889518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:54.896816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:54.901381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0f244ffc-d035-42f3-9860-3d4e29f070b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.219337 May 05 13:55:54.902301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 91/167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:54 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:54.905788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:54.907354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:54.908752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1897b7f5-ac30-4a08-ad42-95c50895cf2e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.218144 May 05 13:55:54.909301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 77/168] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:54 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:55:54.975858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:54.976602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:54.983233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.983681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:54.991200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:54.991200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:55.186417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:55.202707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-caec7eac-9d5c-4068-90a7-941a81b7b717 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1470 microversion: 2.1 time: 0.221682 May 05 13:55:55.203287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 92/169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:54 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:55.918416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:55.919137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:55.927536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:55.931050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:55.931568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:55.932031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:55.932827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:55.933454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:55.937778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:55.938405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:55.939333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:55.939988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:56.299935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:56.303182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:56.311412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:56.312966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:56.314210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da0f6d76-762d-492b-85c7-ed5dcf0de183 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.391168 May 05 13:55:56.325680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc321400-593e-4d69-94a5-938fcdd1604b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.407556 May 05 13:55:56.337174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 78/170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:55 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:56.337361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 93/171] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:55 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:56.357445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:56.359542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:56.372683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:56.373270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:56.374212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:56.375795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:56.902829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:56.911730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f7560ccb-304d-456a-96f9-237aaee21e77 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1470 microversion: 2.1 time: 0.581547 May 05 13:55:56.912600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 79/172] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:56 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1470 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:57.333228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:57.333852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:57.335491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-dd799b5f-091d-4927-8db7-838af8637416 req-64bce271-291c-4142-abc4-f3573eb006c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83bbae3a-1536-4f97-8d64-c39a7b29cf48", "name": "network-vif-deleted", "tag": "ce53e097-61ed-4abb-b0a4-3e1ebda71852"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:55:57.345885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.346439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.347349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-dd799b5f-091d-4927-8db7-838af8637416 req-64bce271-291c-4142-abc4-f3573eb006c0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.347454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.347584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-dd799b5f-091d-4927-8db7-838af8637416 req-64bce271-291c-4142-abc4-f3573eb006c0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.348122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.361833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-dd799b5f-091d-4927-8db7-838af8637416 req-64bce271-291c-4142-abc4-f3573eb006c0 service nova] Creating event network-vif-deleted:ce53e097-61ed-4abb-b0a4-3e1ebda71852 for instance 83bbae3a-1536-4f97-8d64-c39a7b29cf48 on hv-cinder-73761 May 05 13:55:57.368826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-dd799b5f-091d-4927-8db7-838af8637416 req-64bce271-291c-4142-abc4-f3573eb006c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037491 May 05 13:55:57.369605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 80/173] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:55:57.376201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:57.377134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:57.383868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.384338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.385670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.386144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.571188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:57.584711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:57.586307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:57.587504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-08ccbdcb-89fd-457a-a2d5-382718ab000e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.258609 May 05 13:55:57.588107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 94/174] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:57 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:57.599136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:57.611063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bb39333f-0969-4a58-9e3e-0c2a32d9789b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.239922 May 05 13:55:57.611640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 81/175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:57 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:57.930535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:57.931295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:57.937236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.937687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:57.938483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:57.938967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:58.024241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:58.033445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26aba015-e2d1-4be8-8fd7-db767c433a4e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1428 microversion: 2.1 time: 0.106999 May 05 13:55:58.043335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 95/176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:57 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:58.610074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:58.610074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:58.615192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:58.615657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:58.616438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:58.616879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:58.628464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:58.629371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:58.637767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:58.639122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:58.640443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:58.640443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:58.828385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:58.835878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:58.837114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:58.840133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:58.850465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee9d802e-71d9-4777-aefe-14c1786abb5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.220363 May 05 13:55:58.850465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 96/177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:58 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:55:58.854561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ea6a380-4cd5-4f09-9c2b-76d82c071b40 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.241886 May 05 13:55:58.855391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 82/178] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:58 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:55:59.050737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:59.051384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:59.057931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.058572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:59.059383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.059832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:59.130670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:55:59.139837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ed9187f-b5f1-4ac4-95f9-31e3a63c359e tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1428 microversion: 2.1 time: 0.092915 May 05 13:55:59.140419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 97/179] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:59 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:55:59.861058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:59.861719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:59.873565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:55:59.878027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:55:59.881294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.886279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:59.887504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.887894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.888150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:59.888789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:55:59.889710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:55:59.890332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:00.181378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:00.194363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:00.196864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:00.199086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-36413ac9-edbb-4a15-a573-947b9f24496a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.330114 May 05 13:56:00.200389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 98/180] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:55:59 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:00.211749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:00.212795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:00.214956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:00.223370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:00.224107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-098dae3d-2d0b-4af1-9645-57a593cf941d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.366737 May 05 13:56:00.224997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:00.226589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:00.227219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:00.235176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 83/181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:55:59 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:00.330699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:00.339280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5bb8de00-c6b6-41c4-9241-a2ef0b03e0b8 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1428 microversion: 2.1 time: 0.137279 May 05 13:56:00.340187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 99/182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:00 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1428 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:01.224358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:01.225056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:01.233931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.236779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.238115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.238570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.242427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:01.243614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:01.250877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.251593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.252680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.253328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.485227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:01.492752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:01.493944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:01.496119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:01.497367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0fc1b41f-71c4-47aa-b964-051400d1b8f3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.280061 May 05 13:56:01.501025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d15abf43-238d-4297-a287-4fc1fdc4315e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.263811 May 05 13:56:01.501435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 84/183] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:01 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:01.501695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 100/184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:01 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:01.507386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:01.508172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:01.516184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.516653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.517442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.517887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.554159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:01.554618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:01.555082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lazy-loading 'fault' on Instance uuid 83bbae3a-1536-4f97-8d64-c39a7b29cf48 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:56:01.610961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81a6f59026d403f93ee29de20119da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13cfbe72dcc24c108503a3e3b304d435', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:01.618828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9cfdcc48-6863-4949-b03c-fa9acf883d2f tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 200 len: 1304 microversion: 2.1 time: 0.115950 May 05 13:56:01.619853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 85/185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:01 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:02.517115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:02.517729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:02.524656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.525113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.526440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.526552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:02.527097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.527214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:02.534327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.535644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.536663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.537303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.753630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:02.757162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:02.762726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9e403269-8778-40a8-9085-9b408772e80c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.249148 May 05 13:56:02.772653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 101/186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:02 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:02.773402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:02.773402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:02.773402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dee43b5f-b2f1-4bc1-8ada-b0afb8c4a5e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.247049 May 05 13:56:02.773682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b332a744-d43b-4274-9144-421a51304490 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:02.780857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b332a744-d43b-4274-9144-421a51304490 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.781316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b332a744-d43b-4274-9144-421a51304490 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.782176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 86/187] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:02 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:02.787229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:02.787883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] [instance: 83bbae3a-1536-4f97-8d64-c39a7b29cf48] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:02.795015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.795468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.796372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:02.796978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:02.814336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] HTTP exception thrown: Instance 83bbae3a-1536-4f97-8d64-c39a7b29cf48 could not be found. May 05 13:56:02.815325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] Returning 404 to user: Instance 83bbae3a-1536-4f97-8d64-c39a7b29cf48 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:56:02.816374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d70fa3d6-8722-4011-ae38-f8c78ce5a996 tempest-VolumesNegativeTest-114731816 tempest-VolumesNegativeTest-114731816-project] 10.222.0.26 "GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48" status: 404 len: 111 microversion: 2.1 time: 0.032986 May 05 13:56:02.817145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 87/188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:02 2022] GET /compute/v2.1/servers/83bbae3a-1536-4f97-8d64-c39a7b29cf48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:56:02.846947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b332a744-d43b-4274-9144-421a51304490 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Going to try to stop instance {{(pid=123931) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 05 13:56:03.206156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1728365236", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "networks": [{"uuid": "546696f9-6fa1-42b9-bfec-a9cf550f456a"}]}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:03.215523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b332a744-d43b-4274-9144-421a51304490 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action" status: 202 len: 0 microversion: 2.1 time: 0.450704 May 05 13:56:03.220133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 102/189] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:56:02 2022] POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:56:03.230600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:03.232028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:03.238992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.239449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.240236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.240688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.295548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] validate_networks() for [('546696f9-6fa1-42b9-bfec-a9cf550f456a', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:56:03.495238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:03.505101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-65504225-8c24-4dd4-a711-bd29d51171eb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.283330 May 05 13:56:03.506343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 103/190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:03 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:03.784562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:56:03.785050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:56:03.785466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:56:03.785874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:56:03.786434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:56:03.788179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:03.788809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:03.803374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.803374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.803374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.803374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.806482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.807955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.808779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:03.809255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:03.823077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Getting quotas for project c985c8f8f35d402bb2f0b438aa801575. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:56:03.828749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Getting quotas for user 17669504fd1b4ff6a312f73e4cce67d9 and project c985c8f8f35d402bb2f0b438aa801575. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:56:03.851133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:56:03.853588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:56:04.048419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0c0b6a32-db96-4242-a0b8-e648bc012737 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845921 May 05 13:56:04.049092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 88/191] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:56:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:56:04.054691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:04.055342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:04.064826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:04.066712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:04.066712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:04.067162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:04.206938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.219649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-996a35e9-4da8-4afb-a8dc-b1f762dfdf7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.440030 May 05 13:56:04.219649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 104/192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:03 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:04.232178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e99e0d1-ee44-4021-a3ed-90ca88765966 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:04.234441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e99e0d1-ee44-4021-a3ed-90ca88765966 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:04.356187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e99e0d1-ee44-4021-a3ed-90ca88765966 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.366038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e99e0d1-ee44-4021-a3ed-90ca88765966 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1214 microversion: 2.1 time: 0.146444 May 05 13:56:04.367005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 105/193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:04 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:04.389827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.399709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.402073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.403351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-541f9025-50bc-4f15-856d-7d840a43470c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.352665 May 05 13:56:04.403873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 89/194] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:04 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:04.525085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:04.526148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:04.537021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:04.537488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:04.538321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:04.538771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:04.557733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-c9096847-77a0-4f7c-8bcc-6eef20d7fcb8 req-dd2002c5-1f48-42ec-9061-746ee53d595b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8d7ea7-2cac-4aa7-8904-084ff69b44e9", "name": "network-vif-plugged", "status": "completed", "tag": "44bcc933-613c-43d5-b972-9daca9d4c4d9"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:04.576383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-c9096847-77a0-4f7c-8bcc-6eef20d7fcb8 req-dd2002c5-1f48-42ec-9061-746ee53d595b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:04.577018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-c9096847-77a0-4f7c-8bcc-6eef20d7fcb8 req-dd2002c5-1f48-42ec-9061-746ee53d595b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:04.605069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-c9096847-77a0-4f7c-8bcc-6eef20d7fcb8 req-dd2002c5-1f48-42ec-9061-746ee53d595b service nova] Creating event network-vif-plugged:44bcc933-613c-43d5-b972-9daca9d4c4d9 for instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 on hv-cinder-73761 May 05 13:56:04.611121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-c9096847-77a0-4f7c-8bcc-6eef20d7fcb8 req-dd2002c5-1f48-42ec-9061-746ee53d595b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060724 May 05 13:56:04.611834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 90/195] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:56:04.702472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:04.719709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-edafd6bd-f194-4b89-8508-2e0db4c6be88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.198442 May 05 13:56:04.720289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 106/196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:04 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:05.234957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:05.235668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:05.242489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.242947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:05.243736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.244182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:05.390749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-32a6d668-afdc-4566-bf97-445a2f18e4ab tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:05.392248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-32a6d668-afdc-4566-bf97-445a2f18e4ab tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:05.395364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:05.414132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1fb31be7-a9f4-49b8-89a2-ee89f81cac32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.178521 May 05 13:56:05.416770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 91/197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:05 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:05.422417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-690130613", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1069373282", "security_groups": [{"name": "tempest-secgroup-smoke-1971271522"}], "networks": [{"uuid": "5bf37b1c-6099-4f4d-9076-0f1f7db96f0b"}], "block_device_mapping_v2": [{"uuid": "e26d2bbd-2373-404d-99b6-b70200946593", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:05.464363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-32a6d668-afdc-4566-bf97-445a2f18e4ab tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:05.472970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-32a6d668-afdc-4566-bf97-445a2f18e4ab tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1214 microversion: 2.1 time: 0.084485 May 05 13:56:05.474622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 107/198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:05 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:05.487677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:05.487677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:05.497048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.497596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:05.498813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.499117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:05.620235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] validate_networks() for [('5bf37b1c-6099-4f4d-9076-0f1f7db96f0b', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:56:05.738903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:05.748507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:05.750067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:05.751252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a9b12b7-8ce3-46a3-9caa-373cbf5e1dcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.275545 May 05 13:56:05.751829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 108/199] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:05 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:05.756639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:05.757257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:05.763423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.763882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:05.766086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:05.766086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.027491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:06.035836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bab44ec4-cdba-45a6-8e86-83f59864b211 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.282806 May 05 13:56:06.036807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 109/200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:05 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:06.157874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:56:06.158327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:56:06.158805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:56:06.159214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:56:06.159626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:56:06.168933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.169382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.170212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.170654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.187357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for project a4ec75326b484292937db17eccee43f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:56:06.191319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Getting quotas for user df7b5849a9214c41ab39669aa1b62eac and project a4ec75326b484292937db17eccee43f3. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:56:06.250050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:56:06.252252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e26d2bbd-2373-404d-99b6-b70200946593',volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:56:06.433409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:06.434105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:06.440462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.440948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.441777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.442428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.596664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:06.605684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f55156f0-e7ec-4ac3-8b4e-f84627d2d1a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.176777 May 05 13:56:06.607009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 110/201] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:06 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:06.626375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:06.627947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:06.638360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.639474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.640428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.641028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.754664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:06.764273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9482ac64-8199-4bc0-8ec1-3eb848a198e7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1210 microversion: 2.1 time: 0.142681 May 05 13:56:06.765444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 111/202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:06 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1210 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:06.785617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-68b9f6b0-dc2b-4d57-8fe0-3874624f64b1 req-bebd4132-da21-4bcc-8690-b61bca9709e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40e0507-c34b-4015-9186-c21ad9a69e72", "name": "network-vif-plugged", "status": "completed", "tag": "7614c088-27b6-400c-a06c-b3029502882a"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:06.795572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-68b9f6b0-dc2b-4d57-8fe0-3874624f64b1 req-bebd4132-da21-4bcc-8690-b61bca9709e0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.795986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-68b9f6b0-dc2b-4d57-8fe0-3874624f64b1 req-bebd4132-da21-4bcc-8690-b61bca9709e0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.810405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-68b9f6b0-dc2b-4d57-8fe0-3874624f64b1 req-bebd4132-da21-4bcc-8690-b61bca9709e0 service nova] Creating event network-vif-plugged:7614c088-27b6-400c-a06c-b3029502882a for instance c40e0507-c34b-4015-9186-c21ad9a69e72 on hv-cinder-73761 May 05 13:56:06.817261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-68b9f6b0-dc2b-4d57-8fe0-3874624f64b1 req-bebd4132-da21-4bcc-8690-b61bca9709e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050338 May 05 13:56:06.818147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 112/203] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:06.841295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:06.842006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:06.852247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.853163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.854399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:06.855072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:06.879543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9f099b87-2d66-46bd-97d9-cdc76042e7f2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.459203 May 05 13:56:06.893736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 92/204] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:56:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:56:06.904917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d301cc51-881e-4558-a73f-b58fd82c1b6d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:06.905991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d301cc51-881e-4558-a73f-b58fd82c1b6d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:07.035343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d301cc51-881e-4558-a73f-b58fd82c1b6d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.052312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d301cc51-881e-4558-a73f-b58fd82c1b6d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1088 microversion: 2.1 time: 0.151706 May 05 13:56:07.053018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 93/205] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:06 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1088 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:07.078877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:07.079590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:07.105547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.109797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.113296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.114426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.157046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.168666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.171402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.178663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e0ca15d-cf5f-4bfc-aca8-0f6f5f28ac7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.358571 May 05 13:56:07.179555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 113/206] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:06 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:07.303893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.317253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d002a4dc-bc0b-458e-9289-34250c5be8f5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.243011 May 05 13:56:07.317856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 94/207] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:07 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:07.624196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:07.624833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:07.632646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.633414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.634632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.635966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.789058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:07.790521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:07.800232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.801113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.802520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:07.803300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:07.811779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.845037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f76a790-3989-444b-ad02-c35802d942bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.223407 May 05 13:56:07.849851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 114/208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:07 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:07.909102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:07.916618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d458301d-726d-4d85-82ff-3dad86909cd4 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1274 microversion: 2.1 time: 0.132396 May 05 13:56:07.917420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 95/209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:07 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:08.080015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc7a4650-57c2-408f-a0d5-658761bcde3b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:08.080641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dc7a4650-57c2-408f-a0d5-658761bcde3b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:08.184168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc7a4650-57c2-408f-a0d5-658761bcde3b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:08.191711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dc7a4650-57c2-408f-a0d5-658761bcde3b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1088 microversion: 2.1 time: 0.124832 May 05 13:56:08.194530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 115/210] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1088 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:08.197235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:08.198179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:08.205303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.205885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.206726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.207436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.338631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:08.343054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:08.366211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.366770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.371682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.371682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.783063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:08.793511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:08.795106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:08.796317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f4dcc627-901d-4fb4-9360-f048dfd5af64 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.603375 May 05 13:56:08.796922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 96/211] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:08 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:08.824351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:08.838323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-00ab7941-1482-4ce7-ac0b-2e7ffd04f834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.503350 May 05 13:56:08.839406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 116/212] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:08 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:08.864187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:08.864905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:08.872102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.872636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.873438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.873851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.938961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:08.939462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:08.945753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.946243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:08.947007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:08.947985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.050524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:09.065338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df54d8f2-1fab-4c20-8bab-cba64e2e949e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1272 microversion: 2.1 time: 0.129652 May 05 13:56:09.067648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 117/213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:08 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:09.134913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:09.143552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-07731f3e-a32a-4244-b1e4-46b888ea38e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1322 microversion: 2.1 time: 0.283187 May 05 13:56:09.144745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 97/214] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:08 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:09.214651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:09.214743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:09.228763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.229623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.232535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.235325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.356287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:09.364885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1c7b1a6-a8fd-432f-a62f-d7bac19a2e2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1138 microversion: 2.1 time: 0.157290 May 05 13:56:09.366325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 118/215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:09 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1138 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:09.814922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:09.815537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:09.825703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.828528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.828528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.828528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.857791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:09.859783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:09.867215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.868175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:09.870208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:09.870858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.189717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.198350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.200412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.201550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-19442a47-ce09-44fa-a347-40fd54ab689c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1745 microversion: 2.20 time: 0.390690 May 05 13:56:10.216522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 98/216] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:09 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1745 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:10.221614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.223344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:10.224723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:10.231017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eff06c96-fa4d-474e-bfc6-56db91ea9c12 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.378526 May 05 13:56:10.235844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 119/217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:09 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:10.235995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.235995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.236477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.237175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.249203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:10.249922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:10.259513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.260043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.260900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.261352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.528517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.534184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7bd88ed7-3eb6-4fa5-babc-f791d1d23b5a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.316348 May 05 13:56:10.544321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 99/218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:10 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:10.551884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:10.552910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:10.564291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.564291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.564291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.564291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.564747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.578445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ed8da11-5f1d-45b8-8e61-b1ac23956473 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1515 microversion: 2.1 time: 0.343881 May 05 13:56:10.579577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 120/219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:10 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:10.597172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:10.598368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:10.610727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.611427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.616402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:10.617125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:10.645439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:10.657366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e9e3a108-1f0a-484e-8980-3b02a7adae81 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1186 microversion: 2.1 time: 0.109074 May 05 13:56:10.658159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 100/220] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:10.672270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lazy-loading 'flavor' on Instance uuid c40e0507-c34b-4015-9186-c21ad9a69e72 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:56:11.205667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-322f96fd-71f2-4c48-a81f-e78e86d1c661 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72/action" status: 200 len: 32 microversion: 2.1 time: 0.613054 May 05 13:56:11.208771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 121/221] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:56:10 2022] POST /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72/action => generated 32 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 05 13:56:11.228430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:11.231331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:11.259469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.259981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.264170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:11.265401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:11.267717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.268398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.299747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.300199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.300990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.301430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.737128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:11.744009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:11.747501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:11.749365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:11.751326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-00632c02-1ac4-4beb-906b-d9bbef29342e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1745 microversion: 2.20 time: 0.514709 May 05 13:56:11.751818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-10c2b44f-9c66-41a1-8cce-c74f4da791e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.537423 May 05 13:56:11.762310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 101/222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:11 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:11.763890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 122/223] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:11 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1745 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:11.774842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:11.779817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:11.782499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.782962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.783426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-98e253e1-98e4-4bc7-ae88-3b0d5c59f118 req-9a1348cd-cab4-4c7a-a99b-54f4a2086155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ef033b-7cce-45ca-9fbc-f8c72a440db3", "tag": "479c6661-343a-4603-a0af-7838f7b61168"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:11.783755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.784197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.793477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-98e253e1-98e4-4bc7-ae88-3b0d5c59f118 req-9a1348cd-cab4-4c7a-a99b-54f4a2086155 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.794644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-98e253e1-98e4-4bc7-ae88-3b0d5c59f118 req-9a1348cd-cab4-4c7a-a99b-54f4a2086155 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.856522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-98e253e1-98e4-4bc7-ae88-3b0d5c59f118 req-9a1348cd-cab4-4c7a-a99b-54f4a2086155 service nova] Creating event network-changed:479c6661-343a-4603-a0af-7838f7b61168 for instance 67ef033b-7cce-45ca-9fbc-f8c72a440db3 on hv-cinder-73761 May 05 13:56:11.866505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-98e253e1-98e4-4bc7-ae88-3b0d5c59f118 req-9a1348cd-cab4-4c7a-a99b-54f4a2086155 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096534 May 05 13:56:11.870471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 123/224] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:11.881444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:11.883039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:11.892801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.893497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:11.894473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:11.895124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.254393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:12.268503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-803fc14e-b48f-48c9-953b-b5a8e2ae2087 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.508114 May 05 13:56:12.275137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:12.281206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 102/225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:11 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:12.284058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d744ed5d-97e5-4223-8480-6b0f64d1c4cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.412017 May 05 13:56:12.287959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:12.289047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:12.296777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 124/226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:11 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:12.298572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.299890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.301595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.302464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.374642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:12.382720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4e199362-343d-40d7-bab4-33fd1be1c40c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1204 microversion: 2.1 time: 0.099548 May 05 13:56:12.383609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 103/227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:12.484154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-3fdff246-8817-492c-a42a-0b5471d6d8f2 req-44c4e711-5bd1-4b60-a57f-bb299a451666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "name": "network-vif-plugged", "status": "completed", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:12.496067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-3fdff246-8817-492c-a42a-0b5471d6d8f2 req-44c4e711-5bd1-4b60-a57f-bb299a451666 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.496651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-3fdff246-8817-492c-a42a-0b5471d6d8f2 req-44c4e711-5bd1-4b60-a57f-bb299a451666 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.508365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-3fdff246-8817-492c-a42a-0b5471d6d8f2 req-44c4e711-5bd1-4b60-a57f-bb299a451666 service nova] Creating event network-vif-plugged:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:56:12.514454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-3fdff246-8817-492c-a42a-0b5471d6d8f2 req-44c4e711-5bd1-4b60-a57f-bb299a451666 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034158 May 05 13:56:12.515155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 125/228] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:12.793525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:12.794205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:12.800798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.801333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.802439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.803229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.805950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:12.806616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:12.820445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.820947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:12.821693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:12.822166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:13.143184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:13.152679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:13.154733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:13.155933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ff54a96-ef97-45c5-84c8-268d94ce5ba0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.376763 May 05 13:56:13.171178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 104/229] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:12 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:13.253248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:13.262140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e57202b4-214f-40f8-b5c3-f5c998d1a83f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.478761 May 05 13:56:13.273957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 126/230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:12 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:13.287888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:13.288552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:13.300307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:13.300307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:13.300307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:13.300307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:13.302286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:13.303689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:13.333993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:13.336166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:13.338446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:13.340265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.083092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.083092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e74dd7aa-f70d-4dd5-b30a-72d9a3ef1d94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.786945 May 05 13:56:14.083092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 105/231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:13 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:14.083092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:14.083716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:14.087437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.089088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.090126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.091068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.131656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.141949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dce9d327-b36d-437f-86b1-2c116fbfa5e8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.844410 May 05 13:56:14.147807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 127/232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:13 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:14.186429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:14.186429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:14.188413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.188914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.189907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.190373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.395827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.410217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ecad7a14-eada-4154-bd54-29962401fe07 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.336595 May 05 13:56:14.411157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 106/233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:14 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:14.416335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.427057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.433874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.435945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7fb8a643-0ca9-48d5-b1a4-6f34730a390a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.260903 May 05 13:56:14.436424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:14.444107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:14.454952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.461244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.461244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.461244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.478450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 128/234] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:14 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:14.753685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:14.765677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3786676a-ea3f-495d-ae32-aac266e7da9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.351396 May 05 13:56:14.767011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 107/235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:14 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:14.955537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-4c1a32d2-7870-4ca3-ac46-126129a83423 req-2814343d-b217-4d69-b939-39b9563e778d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:14.967876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4c1a32d2-7870-4ca3-ac46-126129a83423 req-2814343d-b217-4d69-b939-39b9563e778d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:14.968888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4c1a32d2-7870-4ca3-ac46-126129a83423 req-2814343d-b217-4d69-b939-39b9563e778d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:14.999710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-4c1a32d2-7870-4ca3-ac46-126129a83423 req-2814343d-b217-4d69-b939-39b9563e778d service nova] Creating event network-changed:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 13:56:15.013788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-4c1a32d2-7870-4ca3-ac46-126129a83423 req-2814343d-b217-4d69-b939-39b9563e778d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060964 May 05 13:56:15.016557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 129/236] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:15.096528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:15.097044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:15.110815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.114522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.118681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.119916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.163732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:15.165027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:15.183354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.185506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.189373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.191186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.711740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:15.722650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bff1af4e-6217-4b60-8258-d26e4c6491af tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.564866 May 05 13:56:15.724859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 130/237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:15 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:15.738683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:15.740000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:15.759090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.761103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.763135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:15.764572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.765137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.773878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed0fc74b-bcdc-4be5-bd6c-355986442435 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.685749 May 05 13:56:15.827887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 108/238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:15 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:15.827887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:15.827887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:15.827887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.828896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:15.828896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:15.828896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.249580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:16.251483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:16.258790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-72f15695-9c22-41dc-aa7c-80f1d67ba816 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.531343 May 05 13:56:16.262881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:16.270826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:16.270990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 131/239] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:16.284345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:16.285862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:16.287553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e32a3ecf-da96-42fb-9921-89d45b62988e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.503929 May 05 13:56:16.297064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.297780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.298613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.299209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.309335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 109/240] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:15 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:16.471086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:16.481237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a992d59c-607f-455e-9ab3-8c0e34596331 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.201461 May 05 13:56:16.482388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 132/241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:16 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:16.741444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:16.743040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:16.756013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.756225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.766168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.766168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.771155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-5fb6df7f-d9f0-441c-a594-b22d690e8423 req-2c2df1ae-8294-4eec-97fa-36f27076690a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ef033b-7cce-45ca-9fbc-f8c72a440db3", "name": "network-vif-plugged", "status": "completed", "tag": "479c6661-343a-4603-a0af-7838f7b61168"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:16.780582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-5fb6df7f-d9f0-441c-a594-b22d690e8423 req-2c2df1ae-8294-4eec-97fa-36f27076690a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.781216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-5fb6df7f-d9f0-441c-a594-b22d690e8423 req-2c2df1ae-8294-4eec-97fa-36f27076690a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.801051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-5fb6df7f-d9f0-441c-a594-b22d690e8423 req-2c2df1ae-8294-4eec-97fa-36f27076690a service nova] Creating event network-vif-plugged:479c6661-343a-4603-a0af-7838f7b61168 for instance 67ef033b-7cce-45ca-9fbc-f8c72a440db3 on hv-cinder-73761 May 05 13:56:16.813662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-5fb6df7f-d9f0-441c-a594-b22d690e8423 req-2c2df1ae-8294-4eec-97fa-36f27076690a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047854 May 05 13:56:16.821202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 133/242] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:56:16.853287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:16.857691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:16.870430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.872591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:16.874006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:16.876911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.087264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.109363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3ca4f7b3-7a69-4e1a-a10b-5fc3ecd06645 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.372425 May 05 13:56:17.121256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 110/243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:16 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:17.160551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.169243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e87cb9bd-6511-4c94-8ffc-3ffbdd9ea816 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.328992 May 05 13:56:17.179743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 134/244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:16 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:17.280782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:17.281696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:17.290046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.290770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.291778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.292372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.314627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:17.319099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:17.330844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.334265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.335397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.336015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.613570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.632239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-725fe03f-f260-4f6b-8233-2f0773a85ce9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.355166 May 05 13:56:17.633459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 111/245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:17 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:17.639453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:17.645000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:17.647281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.647969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.648633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.649819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:17.650653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:17.659683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.661938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.663371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cea4586e-b585-4fcf-8e06-f920f3497bc2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.352602 May 05 13:56:17.664859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 135/246] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:17 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:17.807943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:17.816913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa02e8df-f065-4719-901c-68f83d18acf0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.181036 May 05 13:56:17.817485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 112/247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:17 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:18.126619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:18.127598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:18.136675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.137167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.137957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.138432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.187006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:18.188044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:18.193828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.194251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.195791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.196406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.377666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:18.385997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3225b109-a2cc-4078-943c-82894205d13d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.263159 May 05 13:56:18.387076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 136/248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:18 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:18.410994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:18.419863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-99bcc458-a655-4865-8f21-f56ef06fc432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1724 microversion: 2.1 time: 0.236734 May 05 13:56:18.420449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 113/249] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:18 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:18.652148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:18.653060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:18.661467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.663290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.665401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.665919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.685491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:18.686933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:18.698982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.699439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.700214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:18.700651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:18.985940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:18.998469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95869039-3e45-469b-899c-25ea96943030 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.352106 May 05 13:56:19.002974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.018252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.018369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 137/250] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:19.018453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.018453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3bb173b2-5126-471f-8a42-62d589a33b13 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.336693 May 05 13:56:19.018453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 114/251] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:18 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:19.033785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:19.035762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:19.046125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.046921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.048231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.048869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.321906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.354493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-568064c7-d151-4683-80d7-e999bff37bbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.339306 May 05 13:56:19.362579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 138/252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:19 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:19.405457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:19.407383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:19.414579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.415344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.416897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.417588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.438463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:19.440672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:19.457125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.462114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.463762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.469550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:19.823749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.846187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-df4696a9-a417-4c4c-bacc-1fd44f58cbba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1314 microversion: 2.1 time: 0.443512 May 05 13:56:19.846187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 115/253] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:19 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:19.856630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:19.869440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6cb0043-e40b-4996-b538-60332128a479 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1701 microversion: 2.1 time: 0.436422 May 05 13:56:19.874065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 139/254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:19 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1701 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:19.892560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88bb17ce-1d91-473a-8e73-9488e307803e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:19.900304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88bb17ce-1d91-473a-8e73-9488e307803e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:19.901727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88bb17ce-1d91-473a-8e73-9488e307803e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.013799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88bb17ce-1d91-473a-8e73-9488e307803e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Going to try to start instance {{(pid=123930) start /opt/stack/nova/nova/compute/api.py:2730}} May 05 13:56:20.021954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:20.027781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:20.040092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.042983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.043980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.046486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.287818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:20.296151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ae784ad5-e2b7-4480-9c13-7e3372a52c78 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.279567 May 05 13:56:20.297093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88bb17ce-1d91-473a-8e73-9488e307803e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action" status: 202 len: 0 microversion: 2.1 time: 0.408411 May 05 13:56:20.300839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 116/255] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:56:19 2022] POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:56:20.307367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 140/256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:20 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:20.313909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:20.314835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:20.320413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:20.321588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.322248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.323766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:20.324398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.324993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.337991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.339966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.340901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.341951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.646481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:20.658678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:20.660461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:20.662168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4b403270-6e12-4baa-858e-7da7b0e77512 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.362552 May 05 13:56:20.663719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 117/257] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:20 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:20.669935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:20.670785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:20.678676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.679922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.681016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.681620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.696621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:20.709235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95d3d62b-2e35-446f-988f-007e53d1495f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1710 microversion: 2.1 time: 0.400199 May 05 13:56:20.709831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 141/258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:20 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1710 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:20.866303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:20.867832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:20.880412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.881298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:20.882333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:20.882952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.297043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:21.314392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a8ed6df8-c37e-4656-9e2e-4daf2e49ffba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.639452 May 05 13:56:21.315928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 118/259] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:20 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:21.326422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:21.327181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:21.343356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.344662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.346470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.346941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.431525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:21.445055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0e9d91e9-b682-448c-b7f2-2c6e6d91fd2e tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1498 microversion: 2.1 time: 0.582095 May 05 13:56:21.445324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 142/260] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:20 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1498 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:21.682540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:21.683235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:21.691516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.692135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.699060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.706344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.763597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:21.772352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb5efc9b-87d1-4c55-be5e-b80352fb66bf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.454174 May 05 13:56:21.773245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 119/261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:21 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:21.787688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:21.788400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:21.795451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.796011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:21.796895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:21.797443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.052992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:22.070228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:22.075873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:22.081967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5e6cddc-0a0f-4eab-84a5-fe3be7dfcf0c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.401404 May 05 13:56:22.081967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 143/262] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:21 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:22.096636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:22.108472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8b0ca697-d12c-46bf-b40e-8a65e45ec4af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1710 microversion: 2.1 time: 0.324625 May 05 13:56:22.109068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 120/263] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:21 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1710 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:22.344688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:22.353515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:22.366540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.370634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.371637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.374155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.531362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:22.539750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-892c6f5d-657b-42aa-b775-83a5ddd5586e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.208809 May 05 13:56:22.540322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 144/264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:22 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:22.751458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:22.752756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:22.761489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.761943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.763023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.763662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.794545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:56:22.808531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:22.830195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:22.837219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.837960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.839556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:22.840030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:22.998950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.008145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-96a0d0b9-abed-4330-95bd-01b488bfd5d2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.203354 May 05 13:56:23.008736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 145/265] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:22 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:23.099338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:23.100084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:23.106828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.107372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.108265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.108872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.269086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.277496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.279083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.280245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e9e0ca0-1264-4500-bee4-8bbe1bfa4841 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.185043 May 05 13:56:23.280805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 146/266] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:23 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:23.285082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:23.285686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:23.292678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.293465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.294625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.295376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.426982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.435191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f770dbbd-04fa-44d5-a006-05514cfa9b18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1710 microversion: 2.1 time: 0.153460 May 05 13:56:23.435777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 147/267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:23 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:23.557626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:23.558345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:23.563996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.564450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.566585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.567209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.729797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0a5cbf69-88c4-4a80-80de-21df90fe06d8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 204 len: 0 microversion: 2.1 time: 0.981173 May 05 13:56:23.730738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 121/268] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:56:22 2022] DELETE /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:56:23.739759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:23.740792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:23.758729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.760386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.763006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:23.763969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:23.833395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.848357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8530356e-66e0-4d31-bb41-e07a090c9f95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.295529 May 05 13:56:23.850949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 148/269] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:23 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:23.940233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:23.949193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-52e8d5ed-46eb-4cca-839c-9f98629efabb tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1504 microversion: 2.1 time: 0.213732 May 05 13:56:23.950336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 122/270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:23 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:24.024785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:24.026489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:24.035951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.040244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.040244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.040244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.229988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:24.238469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-320158ba-dddc-4309-93e5-8acb359e3b7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.217552 May 05 13:56:24.240697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 149/271] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:24.309586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:24.311230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:24.330225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.332297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.335742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.337143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.457070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:24.458068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:24.464787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.465328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.466220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.466734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.612061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:24.637703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:24.641181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:24.646265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d34b6518-b0b4-47a5-84ba-fd3b4326d1f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.337375 May 05 13:56:24.646869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 123/272] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:24 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:24.693689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:24.702365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-81b9b0e9-f844-43a8-a064-a528288f240e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1714 microversion: 2.1 time: 0.254439 May 05 13:56:24.714042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 150/273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:24 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1714 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:24.868399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:24.870048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:24.884534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.885709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.889809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.890407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.969029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:24.969802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:24.980529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.981777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:24.983279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:24.983279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:25.121530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.131610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7652a896-420d-4b97-9544-48724d472c46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.270500 May 05 13:56:25.142162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 124/274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:24 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:25.214698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.235530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7fd11fe0-ace0-4847-83af-33dc4d225b19 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1504 microversion: 2.1 time: 0.270780 May 05 13:56:25.237108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 151/275] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:24 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:25.258645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:25.264273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:25.266513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:25.267392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:25.269020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:25.269649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:25.499878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.512635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a611250b-c4b9-4016-85b0-94bcd553a6f9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.258092 May 05 13:56:25.523520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 125/276] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:25.665266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:25.666002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:25.675625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:25.676734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:25.677744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:25.678294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:25.852880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.865669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.867531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:25.868782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-db999314-6a72-4eaf-9a10-14e48acd5212 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.207846 May 05 13:56:25.869963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 152/277] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:25 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:26.152423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:26.152896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:26.164641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.164916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.165799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.166985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.259350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:26.260022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:26.266727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.267176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.267979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.268412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.560314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:26.572105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fc0d1262-f70b-449d-97d8-21697c5107f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.425568 May 05 13:56:26.573774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 126/278] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:26 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:26.579797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:26.580670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:26.592292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.592988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.594043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.594637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.668159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:26.676370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d191850-cb1f-4beb-94f5-559158ef62dc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1504 microversion: 2.1 time: 0.420702 May 05 13:56:26.677147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 153/279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:26 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:26.700282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-47226a9f-3869-40f6-b776-e94a4fad7abb req-a5746aab-c205-4ac6-99ef-bf2f2fb0c847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "name": "network-vif-plugged", "status": "completed", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:26.719861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-47226a9f-3869-40f6-b776-e94a4fad7abb req-a5746aab-c205-4ac6-99ef-bf2f2fb0c847 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.720566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-47226a9f-3869-40f6-b776-e94a4fad7abb req-a5746aab-c205-4ac6-99ef-bf2f2fb0c847 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.742104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-47226a9f-3869-40f6-b776-e94a4fad7abb req-a5746aab-c205-4ac6-99ef-bf2f2fb0c847 service nova] Creating event network-vif-plugged:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 13:56:26.748511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-47226a9f-3869-40f6-b776-e94a4fad7abb req-a5746aab-c205-4ac6-99ef-bf2f2fb0c847 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052330 May 05 13:56:26.752305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 154/280] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:56:26.867940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:26.879110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f3a1f75-8898-42da-a1ed-49196efb80f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.301947 May 05 13:56:26.890507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 127/281] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:26 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:26.903060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:26.903712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:26.917437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.917948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:26.918885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:26.919318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.243868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:27.252829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:27.254427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:27.255596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-87aa1fdb-a716-4b0c-a184-b026a697821b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.366550 May 05 13:56:27.256176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 155/282] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:26 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:27.590739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:27.591354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:27.597717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.598217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.598985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.599428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.693626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:27.694345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:27.701538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.702039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.703028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.703516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.793622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:27.801188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-40de5924-4b43-448b-8df9-dd4b873fd5b5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1462 microversion: 2.1 time: 0.111269 May 05 13:56:27.802196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 156/283] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:27 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:27.809239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:27.817855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-49d919c8-780a-4f50-ae36-0079c180c7c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.231556 May 05 13:56:27.826307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 128/284] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:27 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:27.898802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:27.899423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:27.912720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.912720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.912720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.912720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:27.956261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-e811f446-7b6a-47d6-aa8d-6dff38eb308f req-71f967b2-e65f-465b-8491-c27259f4158a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ef033b-7cce-45ca-9fbc-f8c72a440db3", "name": "network-vif-deleted", "tag": "479c6661-343a-4603-a0af-7838f7b61168"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:27.968687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-e811f446-7b6a-47d6-aa8d-6dff38eb308f req-71f967b2-e65f-465b-8491-c27259f4158a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:27.969559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-e811f446-7b6a-47d6-aa8d-6dff38eb308f req-71f967b2-e65f-465b-8491-c27259f4158a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.014567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-e811f446-7b6a-47d6-aa8d-6dff38eb308f req-71f967b2-e65f-465b-8491-c27259f4158a service nova] Creating event network-vif-deleted:479c6661-343a-4603-a0af-7838f7b61168 for instance 67ef033b-7cce-45ca-9fbc-f8c72a440db3 on hv-cinder-73761 May 05 13:56:28.026094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-e811f446-7b6a-47d6-aa8d-6dff38eb308f req-71f967b2-e65f-465b-8491-c27259f4158a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072986 May 05 13:56:28.026711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 129/285] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:56:28.133119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:28.141667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31bbcea4-f6d1-4fb9-a0bb-2ed881f8c104 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.247244 May 05 13:56:28.142541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 157/286] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:27 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:28.281761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:28.282507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:28.290548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.292464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.293978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.295048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.445468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:28.457633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:28.459714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:28.460962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8417dacb-e34b-485e-b9e6-330d38fd3a28 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.187556 May 05 13:56:28.461709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 130/287] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:28 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:28.819002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:28.819537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:28.825946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.826423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.828896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.828896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.843817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:28.844550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:28.850581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.851042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.851864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.852312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.861939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:28.862538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:28.863008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lazy-loading 'fault' on Instance uuid 67ef033b-7cce-45ca-9fbc-f8c72a440db3 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:56:28.933017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:28.943406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31df5dd6-adcf-4bea-b8b2-19dba80f4411 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1304 microversion: 2.1 time: 0.128222 May 05 13:56:28.953121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 158/288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:28 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:29.010188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:29.033195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-73a10a03-2e3f-4a31-ad63-4f0f0ca1692c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.193168 May 05 13:56:29.034099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 131/289] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:28 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:29.159116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:29.159728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:29.165639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.166176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:29.168445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.168445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:29.303718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:29.311179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-146b50c3-928c-4543-9c59-43f4746f8fcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1260 microversion: 2.1 time: 0.155925 May 05 13:56:29.315896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 159/290] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:29 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:29.479668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:29.480297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:29.486836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.487674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:29.488510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.488954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:29.625290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:29.633203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:29.634858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:29.636533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8a6355b9-7b11-40bc-b9d2-9b3dc9ac6d9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1740 microversion: 2.20 time: 0.161800 May 05 13:56:29.637808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 132/291] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:29 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:29.968204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:29.968728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:29.975183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.975637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:29.976402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:29.976850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.007028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.007478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.007923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lazy-loading 'fault' on Instance uuid 67ef033b-7cce-45ca-9fbc-f8c72a440db3 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:56:30.050467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:30.051542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:30.053354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.058065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.058522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.059302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.059746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.061324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ff1ffbbf-88ce-412c-82fd-bac75e377dc6 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 200 len: 1304 microversion: 2.1 time: 0.097178 May 05 13:56:30.062086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 160/292] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:29 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:30.193877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.201217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c90c14a7-a3fc-4ecd-a494-d6781925a6b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.154650 May 05 13:56:30.201791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 133/293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:30 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:30.328333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:30.328985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:30.335395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.335852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.336625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.337064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.468127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.475466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7212ad16-9658-4f42-8bd7-b05097983db4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1443 microversion: 2.1 time: 0.151001 May 05 13:56:30.476032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 161/294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:30.491660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:30.492278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:30.499039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.499492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.500252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.500687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.628076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.636441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-962b08fd-d010-4f76-aaa7-352fa091021f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1443 microversion: 2.1 time: 0.148331 May 05 13:56:30.636942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 134/295] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:30.659624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:30.659624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:30.663166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.663725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.664624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:30.665071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:30.799541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.808119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.809617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:30.810796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d47a6c7-6a10-4b74-9e07-04ba85b7c081 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1722 microversion: 2.20 time: 0.158853 May 05 13:56:30.811346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 162/296] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:30 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:31.079001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:31.079750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 67ef033b-7cce-45ca-9fbc-f8c72a440db3] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:31.086330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.086782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.087545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.087987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.102281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] HTTP exception thrown: Instance 67ef033b-7cce-45ca-9fbc-f8c72a440db3 could not be found. May 05 13:56:31.102872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Returning 404 to user: Instance 67ef033b-7cce-45ca-9fbc-f8c72a440db3 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:56:31.104197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-238f325c-be7b-417e-9900-3820ac9c8ea5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3" status: 404 len: 111 microversion: 2.1 time: 0.028571 May 05 13:56:31.107092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 135/297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:31 2022] GET /compute/v2.1/servers/67ef033b-7cce-45ca-9fbc-f8c72a440db3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:56:31.202465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1522983591", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "networks": [{"uuid": "546696f9-6fa1-42b9-bfec-a9cf550f456a"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:31.218189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:31.219110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:31.226076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.226611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.227457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.228197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.256750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] validate_networks() for [('546696f9-6fa1-42b9-bfec-a9cf550f456a', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:56:31.442877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:31.450861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-43f5bcba-7714-4286-9263-c96084932b9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.236634 May 05 13:56:31.451488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 136/298] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:31 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:31.675937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:56:31.677048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:56:31.677048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:56:31.677808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:56:31.678958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:56:31.688810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.689489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.690331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.690772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.708887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Getting quotas for project c985c8f8f35d402bb2f0b438aa801575. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:56:31.720751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Getting quotas for user 17669504fd1b4ff6a312f73e4cce67d9 and project c985c8f8f35d402bb2f0b438aa801575. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:56:31.726122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:56:31.728414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:56:31.829555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:31.830206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:31.833126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf09b10d-7976-4ee5-ac40-e6414cda0f40 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634159 May 05 13:56:31.833779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 163/299] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:56:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:56:31.836666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.837113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.837880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:31.838983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:31.844336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-267c8b7b-30ea-4925-922c-7dd920f84847 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:31.844957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-267c8b7b-30ea-4925-922c-7dd920f84847 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:31.942974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-267c8b7b-30ea-4925-922c-7dd920f84847 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:31.956504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-267c8b7b-30ea-4925-922c-7dd920f84847 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1214 microversion: 2.1 time: 0.115882 May 05 13:56:31.960365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 164/300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:31 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:32.009150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:32.017851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:32.019381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:32.020543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1bde08f6-6b1b-4d18-8b9c-94815c26a603 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1722 microversion: 2.20 time: 0.194921 May 05 13:56:32.021094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 137/301] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:31 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:32.467930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:32.468758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:32.475492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:32.476075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:32.476951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:32.477461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:32.610096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:32.618273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eabeae38-cbe7-4ffa-895c-97e8a27625ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.154933 May 05 13:56:32.618852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 165/302] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:32 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:32.976165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:32.976968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:32.984679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:32.985347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:32.986403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:32.986925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.050044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:33.051031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:33.067024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.067599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.074603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.074603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.089529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:33.107298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38f37fb5-012b-40b8-9509-b405c8588894 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1218 microversion: 2.1 time: 0.135461 May 05 13:56:33.108086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 138/303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:32 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:33.125751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-520373fe-620f-429f-a93c-924ecd05ca70 req-5924379e-0674-4260-9107-5458d2e74dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:33.136851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-520373fe-620f-429f-a93c-924ecd05ca70 req-5924379e-0674-4260-9107-5458d2e74dd0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.137577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-520373fe-620f-429f-a93c-924ecd05ca70 req-5924379e-0674-4260-9107-5458d2e74dd0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.155253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-520373fe-620f-429f-a93c-924ecd05ca70 req-5924379e-0674-4260-9107-5458d2e74dd0 service nova] Creating event network-changed:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 13:56:33.157321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-520373fe-620f-429f-a93c-924ecd05ca70 req-5924379e-0674-4260-9107-5458d2e74dd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041828 May 05 13:56:33.158150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 139/304] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:33.164279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-beb88b27-ee46-423f-ad12-01142ce21afd req-37c335fa-0950-48d8-9450-dfd514a77423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "name": "network-vif-unplugged", "status": "completed", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:33.174451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-beb88b27-ee46-423f-ad12-01142ce21afd req-37c335fa-0950-48d8-9450-dfd514a77423 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.174841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-beb88b27-ee46-423f-ad12-01142ce21afd req-37c335fa-0950-48d8-9450-dfd514a77423 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.187214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-beb88b27-ee46-423f-ad12-01142ce21afd req-37c335fa-0950-48d8-9450-dfd514a77423 service nova] Creating event network-vif-unplugged:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:56:33.191862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-beb88b27-ee46-423f-ad12-01142ce21afd req-37c335fa-0950-48d8-9450-dfd514a77423 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032163 May 05 13:56:33.192818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 140/305] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:33.363620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:33.377133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:33.377133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:33.378384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf131b16-026b-498d-98fa-bdaa74effff2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1722 microversion: 2.20 time: 0.333039 May 05 13:56:33.385604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 166/306] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:33 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:33.636599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:33.637403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:33.644071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.644604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:33.645466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:33.646183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:34.090559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:34.112035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b773b142-b501-483d-a0ec-e22d9a22fe32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.480572 May 05 13:56:34.112615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 141/307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:33 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:34.128635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:34.129496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:34.144172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:34.146218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:34.146218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:34.146218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:34.212314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:34.218449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3610657f-3bc7-495c-88dd-61bae049eca5 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1274 microversion: 2.1 time: 0.093620 May 05 13:56:34.219106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 167/308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:34 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:34.396508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:34.397152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:34.403573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:34.404022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:34.404916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:34.405409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:34.539893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:34.548538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:34.550173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:34.551352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-32e52fe9-e2fd-408f-bf57-ef273c93db20 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1722 microversion: 2.20 time: 0.158789 May 05 13:56:34.551905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 142/309] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:34 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:35.128807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:35.129432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:35.135558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.136014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.140677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.140677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.235794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:35.236399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:35.242816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.243267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.244062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.244574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.271116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:35.279319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a790d000-9ffd-45e4-8561-85abe5f62b15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.154424 May 05 13:56:35.279898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 168/310] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:35 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:35.304909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:35.312452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f46d1bfd-fe03-44bf-9917-4705764b91cc tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1274 microversion: 2.1 time: 0.080389 May 05 13:56:35.313021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 143/311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:35 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:35.576502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:35.576502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:35.578736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.579188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.579956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:35.580444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:35.733827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:35.742001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:35.743614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:35.744828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4dc84bd8-b9b8-4e52-b298-e38d1541a061 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1722 microversion: 2.20 time: 0.177109 May 05 13:56:35.745419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 169/312] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:35 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:36.299016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:36.300036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:36.309702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.310933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.311732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.312190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.328914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:36.329540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:36.337295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.337756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.345325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.348314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.488035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:36.502720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0c33c30-e256-4dbe-bf9a-5ffd55363d29 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1272 microversion: 2.1 time: 0.177911 May 05 13:56:36.512812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 170/313] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:36 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:36.591737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:36.599585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-48f3dc35-db96-42a7-a39e-d02c92e5e97c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.308006 May 05 13:56:36.600376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 144/314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:36 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:36.763323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:36.764070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:36.770322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.770778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.771733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.772176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.906480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:36.914748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:36.916353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:36.917471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c16c7112-0fef-414f-a328-295b2de644e0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1725 microversion: 2.20 time: 0.158372 May 05 13:56:36.918043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 171/315] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:36 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:36.935709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "581ce8d7-e3fa-4d36-96d3-f526cbcb7ad3"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:36.936922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:36.943829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.944368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:36.945795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:36.945795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.520754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:37.523922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:37.529783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:37.530278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.531066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:37.531509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.696390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:37.705712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cca8009b-9ca6-43c6-9118-ab45a207c5d3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.188801 May 05 13:56:37.714265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 172/316] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:37 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:37.714265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:37.714265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:37.718574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:37.719030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.719814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:37.720302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.893792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:37.901856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5d367814-08d5-4037-86c5-10f3260a083a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.194523 May 05 13:56:37.903768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 173/317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:37 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:37.907998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-cd7eba6d-2b07-425d-a252-fbe2ff7110b2 req-6867bd66-9364-46c9-9189-117a24a39f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70297ff3-7ef6-4f0f-8027-04feae3352e5", "tag": "90323a93-8e88-4229-8f14-c48efd369cd6"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:37.916042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-cd7eba6d-2b07-425d-a252-fbe2ff7110b2 req-6867bd66-9364-46c9-9189-117a24a39f94 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:37.917171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-cd7eba6d-2b07-425d-a252-fbe2ff7110b2 req-6867bd66-9364-46c9-9189-117a24a39f94 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:37.927970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-cd7eba6d-2b07-425d-a252-fbe2ff7110b2 req-6867bd66-9364-46c9-9189-117a24a39f94 service nova] Creating event network-changed:90323a93-8e88-4229-8f14-c48efd369cd6 for instance 70297ff3-7ef6-4f0f-8027-04feae3352e5 on hv-cinder-73761 May 05 13:56:37.937650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-cd7eba6d-2b07-425d-a252-fbe2ff7110b2 req-6867bd66-9364-46c9-9189-117a24a39f94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030452 May 05 13:56:37.937650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 174/318] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:56:38.161728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d95c0898-7111-4638-97ea-816b5eb5a88b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.230626 May 05 13:56:38.167238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 145/319] 10.222.0.26 () {62 vars in 1363 bytes} [Thu May 5 13:56:36 2022] POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 188 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:56:38.278798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:38.279449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:38.285427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.287457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.287457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.287457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.587235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4d3c5e80-c651-4886-9480-242ea9332cb8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/action" status: 202 len: 0 microversion: 2.20 time: 0.312717 May 05 13:56:38.588601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 175/320] 10.222.0.26 () {62 vars in 1318 bytes} [Thu May 5 13:56:38 2022] POST /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 05 13:56:38.596803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:38.597703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:38.605482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.610644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.610644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.610644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.724271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:38.724895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:38.740892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.741349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.742236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.742680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.770001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:38.781028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:38.783100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:38.784854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-398121ce-b9fc-42e8-9e8b-5aaba73e97c1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1751 microversion: 2.20 time: 0.191787 May 05 13:56:38.797394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 146/321] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:38 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:38.920128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:38.920834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:38.928519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:38.932617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.932617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.932617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:38.932617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:38.937152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-731c4a7c-98d0-45cb-9f50-d21e06be9dc8 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.218127 May 05 13:56:38.938298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 176/322] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:38 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:39.073369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:39.081422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d4feba6-21f6-48ce-ac5a-bf28a65cb895 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.165908 May 05 13:56:39.081977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 147/323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:38 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:39.804218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:39.804950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:39.812438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:39.812990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:39.813854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:39.814334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:39.955042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:39.955795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:39.955927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:39.966869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:39.967348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:39.968230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:39.968663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:39.972536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:39.974193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:39.975366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dcee1f03-d348-494d-8d99-80dbe689fe3d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1751 microversion: 2.20 time: 0.175211 May 05 13:56:39.975915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 177/324] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:39 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:40.102174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:40.102813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:40.111109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:40.112389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:40.113407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:40.114092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:40.134258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:40.144384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-914b67ba-162b-4922-908a-a8f2a207d786 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.193321 May 05 13:56:40.145561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 148/325] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:39 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:40.289340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:40.297698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9d96e3a5-cb60-4423-8392-1541ee9aa396 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.202469 May 05 13:56:40.298494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 178/326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:40 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:40.993505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:40.994216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:41.000637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.001093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.001864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.002324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.159050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:41.161997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:41.162746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:41.169430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:41.171343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:41.172161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-81b00401-f726-4518-9669-8b609cbcd371 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1751 microversion: 2.20 time: 0.182530 May 05 13:56:41.172584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.172894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 149/327] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:40 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:41.173033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.175059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.175682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.315445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:41.318158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:41.319553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:41.326607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f9236c91-dce0-43a9-9dd0-4edd68cdfb91 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.168120 May 05 13:56:41.326843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 179/328] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:41 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:41.332422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.332882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.333935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:41.334402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:41.489248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:41.496758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8b7b0a0c-9241-461c-8e4a-ccdfb28e9803 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.185506 May 05 13:56:41.497722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 150/329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:41 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:42.193240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:42.193844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:42.201133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.201588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.203750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.203750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.330168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:42.339176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:42.340784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:42.342031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a200534b-89bb-4e30-bfa2-1b34441615da tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1753 microversion: 2.20 time: 0.153147 May 05 13:56:42.342702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 180/330] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:42 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:42.343921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:42.344539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:42.351133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.351584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.352354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.352793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.494083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:42.502135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30376ccb-f479-422d-a2b4-89e167536e46 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.162285 May 05 13:56:42.502887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 151/331] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:42 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:42.513690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:42.514428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:42.520326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.520860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.521713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:42.522251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:42.653541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:42.660816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-343750d7-8ebb-4a38-8bcc-6dc4edc8ec37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.151063 May 05 13:56:42.661382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 181/332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:42 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:43.262354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-a1262b5a-0ce2-406b-b27c-9bcbebc3aef6 req-8981e6ed-e161-476e-a226-acf1105e3026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70297ff3-7ef6-4f0f-8027-04feae3352e5", "name": "network-vif-plugged", "status": "completed", "tag": "90323a93-8e88-4229-8f14-c48efd369cd6"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:56:43.270708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-a1262b5a-0ce2-406b-b27c-9bcbebc3aef6 req-8981e6ed-e161-476e-a226-acf1105e3026 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.271160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-a1262b5a-0ce2-406b-b27c-9bcbebc3aef6 req-8981e6ed-e161-476e-a226-acf1105e3026 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.284377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-a1262b5a-0ce2-406b-b27c-9bcbebc3aef6 req-8981e6ed-e161-476e-a226-acf1105e3026 service nova] Creating event network-vif-plugged:90323a93-8e88-4229-8f14-c48efd369cd6 for instance 70297ff3-7ef6-4f0f-8027-04feae3352e5 on hv-cinder-73761 May 05 13:56:43.289579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-a1262b5a-0ce2-406b-b27c-9bcbebc3aef6 req-8981e6ed-e161-476e-a226-acf1105e3026 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 May 05 13:56:43.290243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 152/333] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:56:43.360701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:43.361315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:43.369702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.389955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.389955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.389955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.520689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:43.521583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:43.528314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.528939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.529824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.530529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.961937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:43.971018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:43.972604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:43.973773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3d10685d-73c5-4f30-a9cf-16d91dd9a452 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.617002 May 05 13:56:43.974562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 182/334] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:43 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:43.980666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:43.980666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:43.986109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.986568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:43.987349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:43.987795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:44.004623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:44.015370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e35f655c-e2b3-4478-8b9a-9c20943cceca tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.499551 May 05 13:56:44.016519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 153/335] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:43 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:44.140227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:44.148272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ab452549-c4b0-486b-a0cb-f76ac8192161 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.172944 May 05 13:56:44.159078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 183/336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:43 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:44.992118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:44.992757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:45.002044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.002044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.002044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.002044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.032979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:45.033773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:45.040456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.041199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.042672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.043275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.186272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:45.195514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:45.197128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:45.198502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d40f9e48-5167-411b-94a6-e29dc810bfc1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.210278 May 05 13:56:45.199558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 154/337] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:44 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:45.204237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:45.204965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:45.211412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.212175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.213706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:45.214395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:45.236419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:45.246337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-50aba224-fb21-46da-9885-25b9a80330ba tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.217247 May 05 13:56:45.258203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 184/338] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:45 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:45.369717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:45.377061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7332456c-8733-4daf-8497-810cfed4ddd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.176278 May 05 13:56:45.377633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 155/339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:45 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:46.218589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:46.219924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:46.229468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.230002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.231558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.231558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.263723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:46.264788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:46.271289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.271982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.272953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.273555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.443564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:46.463826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:46.465373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:46.466617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c306ac61-eed2-4509-980a-285c1cd95bc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.253825 May 05 13:56:46.474131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 185/340] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:46 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:46.474131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:46.474131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:46.479352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.479812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.480604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:46.481046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:46.484001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:46.491669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-77e44b7e-61da-4858-9f1f-b3027dd6f53c tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.232448 May 05 13:56:46.492227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 156/341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:46 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:46.623345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:46.631374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee94ca07-ae44-4af1-9000-7e5d06b33b4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.162845 May 05 13:56:46.632366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 186/342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:46 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:47.486682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:47.487474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:47.494934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.495781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.496472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.497111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.509734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:47.510414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:47.520243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.520542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.521373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.521819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.711484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:47.725451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:47.727262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:47.731662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-16596fef-7748-47df-897f-0d97a02403c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.249985 May 05 13:56:47.732523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 157/343] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:47 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:47.758497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:47.761973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:47.780650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.780650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.780650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:47.780650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:47.800878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:47.809048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6a79e166-dedd-4639-b3e3-ce666791b474 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.303690 May 05 13:56:47.809621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 187/344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:47 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:48.004019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:48.014887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5de257d3-68fd-4f44-b932-d7aae6b1c137 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.268103 May 05 13:56:48.016271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 158/345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:47 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:48.753158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:48.754502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:48.771663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:48.772324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:48.773449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:48.774393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:48.831891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:48.832687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:48.841787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:48.842419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:48.843306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:48.843853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:49.067290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:49.078722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:49.084579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:49.088683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-66f0663d-44cb-4940-a666-653e6f9e270e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.340604 May 05 13:56:49.095143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:49.100909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 188/346] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:48 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:49.108278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:49.112964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:49.121901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:49.122699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:49.123696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:49.124119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ddeb47d-7dc6-49e6-bef9-828771196c8d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.298963 May 05 13:56:49.124502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:49.124962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 159/347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:48 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:49.315788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:49.324735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-502a93a6-2ac5-48af-9bab-7f5b045817da tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.220862 May 05 13:56:49.327211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 189/348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:49 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:50.112271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:50.113808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:50.128501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.128811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.129611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.130083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.154305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:50.154928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:50.165168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.165961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.171131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.171854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.441624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:50.450210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:50.451706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:50.452874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa979ed1-7b2e-4032-ad8f-829f8b2a3c0b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.349068 May 05 13:56:50.453424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 160/349] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:50 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:50.458115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:50.459221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:50.466038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.466731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.467516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:50.468114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:50.471933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:50.481946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-07e9e3b6-0ead-4d10-a2eb-8b4ea5e92884 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.332859 May 05 13:56:50.492300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 190/350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:50 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:50.634710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:50.643500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c75ce784-32da-4897-8358-0fd8cc30ee07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.188868 May 05 13:56:50.644305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 161/351] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:50 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:51.473539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:51.474905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:51.484094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.484553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.485337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.485781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.499286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:51.500151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:51.510183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.510910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.511682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.512114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.710103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:51.726156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:51.726156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:51.726678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:51.726771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f7c3942f-0f90-43a5-975a-0b02bb1111d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.254982 May 05 13:56:51.726771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 191/352] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:51 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:51.730554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:51.731326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:51.731514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-167da634-4bff-46f4-8c2d-54cb57e5b629 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.236889 May 05 13:56:51.737696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.738517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 162/353] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:51 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:51.742594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.743557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:51.744197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:51.888162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:51.895934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf1196d0-ff84-4965-b1b1-bb67692ef00a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.170541 May 05 13:56:51.896513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 192/354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:51 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:52.743376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:52.745042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:52.748831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:52.750389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:52.757287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.761796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.761960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.762076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.762176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.762269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.762362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.762362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.957790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:52.967513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a68b2e0f-d5c2-4ba5-8589-a18108dfac3d tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.222769 May 05 13:56:52.968092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 193/355] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:52 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:52.974960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:52.977475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:52.978132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:52.983477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:52.984681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.985014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:52.985200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.986093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:52.986203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b9f2eb9-81ba-4a3e-aee4-1d971a6581bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.246928 May 05 13:56:52.986700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:52.986832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 163/356] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:52 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:53.141927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:53.155977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-692a01bc-b87b-4a04-9e1f-a1fc55de5c32 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.182216 May 05 13:56:53.156571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 194/357] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:52 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:53.985272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:53.985819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:53.992381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:53.992833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:53.993614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:53.994095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:54.004929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:54.006659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:54.015464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:54.016982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:54.018428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:54.018856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:54.201199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:54.212175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d761812e-cbd9-41a5-ab60-20bd0969b1aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.230720 May 05 13:56:54.213064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 164/358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:53 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:54.218977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:54.220026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:54.236885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:54.237312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:54.238148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:54.238654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:54.241559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:54.253584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:54.256305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:54.258896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-24c7a93f-25d6-442b-8fc0-d6ed3e1e5ce1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.257765 May 05 13:56:54.271814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 195/359] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:54 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:54.407167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:54.414435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c65c1ea-a9d2-4897-8777-71ac2551296e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.199859 May 05 13:56:54.415003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 165/360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:54 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:55.229217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:55.229853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:55.237531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.238716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.239172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.239723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.278901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:55.279615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:55.286449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.286908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.287698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.288198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.440666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:55.456682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-218d05aa-8953-4913-8d15-bf6c2b072bf3 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.231704 May 05 13:56:55.457925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 196/361] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:55 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:55.463498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:55.465225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:55.471813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.472563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.473558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:55.474747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:55.512689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:55.522729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:55.524710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:55.527002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-90393265-5f78-49bf-a229-d7c1f45d7bb1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.252090 May 05 13:56:55.539233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 166/362] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:55 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:55.650192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:55.658472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ad123bec-8a74-4407-8087-2ff33ef887a3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.198983 May 05 13:56:55.659057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 197/363] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:55 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:56.476511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:56.477153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:56.484378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.488692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.488692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.488692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.546098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:56.546986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:56.553795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.554516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.555399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.555934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.640950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:56.648306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f0e610da-4298-48f7-af98-0b1988332667 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1314 microversion: 2.1 time: 0.175739 May 05 13:56:56.648876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 167/364] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:56 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:56.675804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:56.676480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:56.682483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.688721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.688721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:56.688721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:56.717015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:56.731743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:56.733183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:56.734420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-50c1bc50-f61d-426a-a09f-b5381b6892ae tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.192806 May 05 13:56:56.745391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 198/365] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:56 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:56:56.831654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:56.860630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-23647290-0933-4d48-9a0c-8b074abe6544 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.188908 May 05 13:56:56.861223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 168/366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:56 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:57.667256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:57.667934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:57.674432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.674889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.675858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.676299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.752004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:57.752571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:57.760552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.760552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.761764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.762248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.818313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:57.826423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-43de145f-ccf8-430d-8484-2d8f21c9eb7f tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1497 microversion: 2.1 time: 0.163531 May 05 13:56:57.827298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 199/367] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:57 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:56:57.876821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:57.877433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:57.883770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.884489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.886052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:57.886691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:57.906494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:57.915504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:57.917367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:57.918689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cb797313-f5fd-47f9-adb5-db2411022550 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.170755 May 05 13:56:57.919332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 169/368] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:57 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:58.023019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:58.030753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a5cffdda-5223-4702-9e44-b8d19412ca62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.157917 May 05 13:56:58.032179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 200/369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:57 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:56:58.937642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:58.938313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:58.944652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:58.945104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:58.945867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:58.946324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:59.048546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:56:59.049390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:56:59.056296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:59.056749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:59.058254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:56:59.058693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:56:59.080109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:59.089523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:59.091376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:59.092580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5311edbe-8406-448f-82b7-c64043027708 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.158807 May 05 13:56:59.104788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 170/370] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:56:58 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:56:59.218708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:56:59.226007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-70523e34-9bdf-4366-9bd8-80e9ba53b871 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.181314 May 05 13:56:59.226607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 201/371] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:56:59 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:00.112252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:00.112884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:00.119363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:00.121908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:00.121908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:00.121908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:00.242886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:00.243493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:00.250692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:00.254776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:00.254776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:00.254776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:00.255985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:00.265023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:00.266551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:00.267716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b9c9c25-feb3-4f69-b493-8a7f80827568 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.159368 May 05 13:57:00.268274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 171/372] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:00 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:00.383176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:00.393336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe210575-cc85-4896-8156-04e790fed355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.154620 May 05 13:57:00.394092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 202/373] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:00 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:00.995484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:00.996252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:01.002408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.002870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.003648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.004134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.029601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:57:01.288235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:01.289768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:01.299827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.299827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.303888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.306537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.404324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8ca96b12-53fb-4528-8290-1373e4ae05bf tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "DELETE /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 204 len: 0 microversion: 2.1 time: 0.408567 May 05 13:57:01.408836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 172/374] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:57:00 2022] DELETE /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:57:01.424364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:01.425773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:01.432348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.432947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.433838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.434452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.597283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:01.613193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:01.615760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:01.617449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-063a723b-e2e3-4b12-856b-a603fb819616 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.334241 May 05 13:57:01.618562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 203/375] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:01 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:01.623648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:01.624477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:01.632038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.632896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.633900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:01.634676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:01.641294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:01.645698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-02002e05-d358-4408-bef7-1c082f43d298 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.235528 May 05 13:57:01.646700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 173/376] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:01 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:01.796137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:01.802206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3adbaf02-9670-4a72-979b-691f240c7fed tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1503 microversion: 2.1 time: 0.182201 May 05 13:57:01.802784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 204/377] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:01 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:02.636363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:02.637329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:02.644323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.645204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:02.646186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.646736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:02.663981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:02.664619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:02.674381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.675666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:02.678232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.679021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:02.863427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:02.873178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:02.874802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:02.876877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e3c05822-b78a-4845-9936-213c33ba14ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.244192 May 05 13:57:02.878066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 174/378] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:02 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:02.882684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:02.883634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:02.887917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:02.898591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.899252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:02.899400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1f289616-64e7-4667-b617-ab7c3ccd74dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.239140 May 05 13:57:02.900284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 205/379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:02 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:02.900636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:02.901646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:03.047213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:03.055256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ed56d7a-ae1c-4ece-bbc8-2a622670c462 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1503 microversion: 2.1 time: 0.176019 May 05 13:57:03.055825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 175/380] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:02 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:03.896129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:03.898857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:03.906958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:03.907474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:03.908264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:03.908783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:03.916563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:03.917169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:03.927287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:03.928896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:03.930985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:03.933603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:04.165910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:04.186105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:04.187606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:04.191146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6933fec5-bd43-4355-a3bf-759129595a99 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.297080 May 05 13:57:04.201882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 206/381] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:03 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:04.211344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:04.215030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:04.219430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:04.227897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-93962b0c-06bc-4bc9-85e5-511fdc9fb317 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.314591 May 05 13:57:04.229959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:04.230459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:04.231267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:04.231711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:04.238493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 176/382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:03 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:04.462000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:04.473477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f17b7567-2fd9-451b-b08d-d6c02f6c6781 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1503 microversion: 2.1 time: 0.274117 May 05 13:57:04.474349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 207/383] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:04 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:05.139512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-767744d5-f5a5-490c-9852-59291ce3a7d2 req-b7195a3d-7eb8-490e-a0f0-f59ba68b4dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70297ff3-7ef6-4f0f-8027-04feae3352e5", "name": "network-vif-deleted", "tag": "90323a93-8e88-4229-8f14-c48efd369cd6"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:05.149569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-767744d5-f5a5-490c-9852-59291ce3a7d2 req-b7195a3d-7eb8-490e-a0f0-f59ba68b4dfe service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.150322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-767744d5-f5a5-490c-9852-59291ce3a7d2 req-b7195a3d-7eb8-490e-a0f0-f59ba68b4dfe service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.162341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-767744d5-f5a5-490c-9852-59291ce3a7d2 req-b7195a3d-7eb8-490e-a0f0-f59ba68b4dfe service nova] Creating event network-vif-deleted:90323a93-8e88-4229-8f14-c48efd369cd6 for instance 70297ff3-7ef6-4f0f-8027-04feae3352e5 on hv-cinder-73761 May 05 13:57:05.167851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-767744d5-f5a5-490c-9852-59291ce3a7d2 req-b7195a3d-7eb8-490e-a0f0-f59ba68b4dfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 May 05 13:57:05.168503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 177/384] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:57:05.233408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:05.234631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:05.243682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.244128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.247613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:05.247613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:05.247969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.248406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.253214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.253601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.254414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.254851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.446745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:05.471329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-040bc417-8f31-41f8-9262-5293b443a5b7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1521 microversion: 2.1 time: 0.230350 May 05 13:57:05.471647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:05.474935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 178/385] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:05 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:05.495679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:05.503658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:05.507282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:05.508317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:05.510608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-037e1b2f-ea79-44bd-90a5-8ab7453dd03a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.294998 May 05 13:57:05.524220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 208/386] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:05 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:05.533046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.533046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.533046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:05.536162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:05.607067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:05.614591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ae18328c-6b4c-4a1f-a9ad-64910ec5f05a tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1299 microversion: 2.1 time: 0.124721 May 05 13:57:05.615155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 179/387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:05 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:06.492364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:06.492989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:06.500483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.500945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.501729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.502375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.529025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:06.530367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:06.544344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.544968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.545891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.547110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.761037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.765892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.775097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.776145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95176567-d546-4ce6-8bc4-6320152d906a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1501 microversion: 2.1 time: 0.286380 May 05 13:57:06.777483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 209/388] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:06 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1501 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:06.778594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.780080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-34465f97-6a46-4895-a5f4-b2c703b3abf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.255035 May 05 13:57:06.783011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:06.783850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:06.791840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 180/389] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:06 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:57:06.797022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:06.797701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:06.803863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.804453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.805498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.806008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.806541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.807687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.808521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.808969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.858705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:06.865956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:06.865956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lazy-loading 'fault' on Instance uuid 70297ff3-7ef6-4f0f-8027-04feae3352e5 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:57:06.921401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17669504fd1b4ff6a312f73e4cce67d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c985c8f8f35d402bb2f0b438aa801575', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.929452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2515ca9-7638-4145-a251-3c11ae71e0c7 tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 200 len: 1304 microversion: 2.1 time: 0.150055 May 05 13:57:06.930294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 210/390] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:06 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:06.992302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:06.999765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d1ab63c5-25d5-4d34-b446-abe71b7d9164 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1515 microversion: 2.1 time: 0.206636 May 05 13:57:07.000582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 181/391] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:06 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:07.800960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:07.803045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:07.814227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:07.814227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:07.814227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:07.814227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:07.952154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:07.952903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] [instance: 70297ff3-7ef6-4f0f-8027-04feae3352e5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:07.955375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:07.960194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:07.960854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:07.961750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:07.962206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:07.967051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:07.969573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:07.970778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75838c71-4bdb-47f2-a33e-d5a4fea580dd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.176664 May 05 13:57:07.971330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 211/392] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:07 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:07.991394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] HTTP exception thrown: Instance 70297ff3-7ef6-4f0f-8027-04feae3352e5 could not be found. May 05 13:57:07.991394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] Returning 404 to user: Instance 70297ff3-7ef6-4f0f-8027-04feae3352e5 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:57:07.991394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-951fc351-636e-45f4-a388-6a232d6d85aa tempest-VolumesActionsTest-78862492 tempest-VolumesActionsTest-78862492-project] 10.222.0.26 "GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5" status: 404 len: 111 microversion: 2.1 time: 0.040041 May 05 13:57:07.991394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 182/393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:07 2022] GET /compute/v2.1/servers/70297ff3-7ef6-4f0f-8027-04feae3352e5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:57:08.240030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-27b7e816-6b64-4f6d-80b5-fd6973dd157a req-db0d1dfe-537d-4bc4-aad7-89e6357b761b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "name": "network-vif-plugged", "status": "completed", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:08.255896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-27b7e816-6b64-4f6d-80b5-fd6973dd157a req-db0d1dfe-537d-4bc4-aad7-89e6357b761b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:08.256934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-27b7e816-6b64-4f6d-80b5-fd6973dd157a req-db0d1dfe-537d-4bc4-aad7-89e6357b761b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:08.303396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-27b7e816-6b64-4f6d-80b5-fd6973dd157a req-db0d1dfe-537d-4bc4-aad7-89e6357b761b service nova] Creating event network-vif-plugged:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:57:08.313763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-27b7e816-6b64-4f6d-80b5-fd6973dd157a req-db0d1dfe-537d-4bc4-aad7-89e6357b761b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080565 May 05 13:57:08.314449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 212/394] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:57:08.992962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:08.995574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:09.004370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:09.005792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:09.005792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:09.006513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:09.230556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:09.247585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:09.249679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:09.251405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f98c4d21-26cc-40ae-8d63-eda005e18846 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.264127 May 05 13:57:09.266135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 183/395] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:08 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:10.274353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:10.275057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:10.281303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:10.281760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:10.282565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:10.283018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:10.509076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:10.520663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:10.522267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:10.523622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e70d59a6-6c4d-4130-b987-21d538497d36 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.254214 May 05 13:57:10.524562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 213/396] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:10 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:11.542793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:11.543419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:11.552806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:11.553387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:11.554441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:11.554987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:11.726758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:11.743092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:11.745362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:11.746749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e02a1578-0c4e-4e3a-a6d1-14a5ea1a2eed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.208511 May 05 13:57:11.747415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 184/397] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:11 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:12.765693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:12.767186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:12.774132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:12.774595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:12.775391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:12.776362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:12.918108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:12.930563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:12.930563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:12.930563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7a296a37-fcf1-4fa5-84c4-8c1ba6b49144 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.168338 May 05 13:57:12.930878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 214/398] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:12 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:14.058857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:14.058857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:14.058857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.058857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.062868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.062868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.175580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:14.176692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:14.188279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.189097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.201070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.201878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.231715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:14.255107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:14.255107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:14.255107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8a5426d8-a42d-46e0-9829-a6c97d9ec0ab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.304985 May 05 13:57:14.255426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 185/399] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:13 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:14.255524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lazy-loading 'flavor' on Instance uuid 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:57:14.579926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d4942678-0cb9-428f-8364-0ead85d0ffee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/action" status: 200 len: 32 microversion: 2.1 time: 0.408468 May 05 13:57:14.585211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 215/400] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:57:14 2022] POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 05 13:57:14.598396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:14.603584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:14.640742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.641114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.653206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:14.653724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:14.899916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:14.909653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a34d505-ffef-47ef-917b-892ec0f89547 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.323372 May 05 13:57:14.913064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 186/401] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:14 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:15.272258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:15.273627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:15.288559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:15.296093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:15.297351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:15.297942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:15.681551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:15.692506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:15.697454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:15.699320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0b0c69c5-8d2f-4ff4-aa10-1354de5cf945 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.431275 May 05 13:57:15.703174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 216/402] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:15 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:15.932351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:15.933786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:15.956357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:15.957952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:15.959113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:15.960285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:16.222177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:16.231909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0eadf74b-787b-4228-aae1-b469a8e89a63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.305642 May 05 13:57:16.244922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 187/403] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:15 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:16.721375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:16.722006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:16.735203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:16.735659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:16.740009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:16.740471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:17.038983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:17.051755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:17.055615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:17.057546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-45fda429-f5a3-4a47-a36e-a2c8c2580a38 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.340044 May 05 13:57:17.060733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 217/404] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:16 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:17.251738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:17.254781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:17.271696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:17.275642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:17.281483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:17.285630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:17.610411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:17.622265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7f302960-fdc0-4850-ab8b-41652752ad5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.375804 May 05 13:57:17.624172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 188/405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:17 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:18.078969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:18.079587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:18.086955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:18.087410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:18.088705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:18.089151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:18.341704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:18.353143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:18.355434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:18.356636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b250da9d-f8e2-43a4-a126-e6f038220413 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.281680 May 05 13:57:18.357204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 218/406] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:18 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:18.651677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:18.652248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:18.660560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:18.668045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:18.669448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:18.670222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:18.972994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:18.982518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f2551930-f1f3-4e32-86ca-541ec924cb4e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.337063 May 05 13:57:18.986298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 189/407] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:18 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:19.374727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:19.375693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:19.388835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:19.395721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:19.396774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:19.400609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:19.672945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:19.682675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:19.693639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:19.696156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-19551f55-c96d-486a-9802-72143cbee762 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.325566 May 05 13:57:19.703422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 219/408] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:19 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:20.003722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:20.004763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:20.019241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:20.022262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:20.025248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:20.029036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:20.436220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:20.445721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-897ebab0-e9a5-4df9-9548-b251e49362f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.448280 May 05 13:57:20.452370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 190/409] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:19 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:20.723536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:20.724761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:20.732530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:20.733225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:20.734063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:20.734511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:21.144318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:21.169304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:21.171951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:21.176053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-13206d3b-b240-4f1c-a65f-dcffe48e259c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.456225 May 05 13:57:21.177940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 220/410] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:20 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:21.469544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:21.470197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:21.478463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:21.482396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:21.483505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:21.484119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:21.766706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:21.775199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e09f667-6b3c-4557-bc7d-072e9c214e42 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.310215 May 05 13:57:21.778330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 191/411] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:21 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:22.211293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:22.212747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:22.223844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:22.224905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:22.226091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:22.226832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:22.437001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:22.447216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:22.449909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:22.452734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-65d5f4a9-699a-4aff-b8ca-4001c07a46b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.248590 May 05 13:57:22.453686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 221/412] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:22 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:22.795442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:22.796800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:22.803727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:22.804225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:22.805079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:22.805571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:22.941937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:22.954046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-16a7e118-d41b-4b0b-a96e-d067a02af057 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.163400 May 05 13:57:22.954650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 192/413] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:22 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:23.473199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:23.473958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:23.482413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:23.484629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:23.486133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:23.486826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:23.675592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:23.687658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:23.690118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:23.691859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-07c05909-71d5-4573-b349-a9091cdff941 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.223478 May 05 13:57:23.706242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 222/414] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:23 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:23.982955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:23.984377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:23.991917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:23.992730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:23.993773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:23.995019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:24.208840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:24.209978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:24.221412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:24.221904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:24.222715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:24.228304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:24.280040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:24.290318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-138a1cc9-870f-4641-b9ec-93131a1d81d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.314182 May 05 13:57:24.292379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 193/415] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:23 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:24.423377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:57:24.715567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:24.716777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:24.726645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:24.727417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:24.728384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:24.729761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:24.811823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6a4d5240-7352-4a55-952c-ed997e57beed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments/7daf29de-c989-4f17-84ad-132dd8834c9f" status: 202 len: 0 microversion: 2.1 time: 0.606650 May 05 13:57:24.815650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 223/416] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 13:57:24 2022] DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments/7daf29de-c989-4f17-84ad-132dd8834c9f => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:57:25.081560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:25.095122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:25.100823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:25.103208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8817f2d8-1387-4a82-a820-387900cee336 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.396640 May 05 13:57:25.104867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 194/417] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:24 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:25.313089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:25.314797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:25.329959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:25.333793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:25.335317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:25.336398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:25.574231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:25.584870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-db3d6041-9ceb-4f23-b797-2c410a990951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.278313 May 05 13:57:25.597074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 224/418] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:25 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:26.123354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:26.124088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:26.132057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:26.132734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:26.133538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:26.133978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:26.317492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:26.332505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:26.334097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:26.335577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0263d36f-f6ee-4586-bc77-9824f5effe47 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.217398 May 05 13:57:26.336152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 195/419] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:26 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:26.602500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:26.603110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:26.609990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:26.610466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:26.611219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:26.611651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:26.744195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:26.757633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8751c89e-75ef-4f20-8b98-813674c4986a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.158931 May 05 13:57:26.767219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 225/420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:26 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:27.145883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b07eb655-79da-4606-a8ed-183e4d8377d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:27.155458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b07eb655-79da-4606-a8ed-183e4d8377d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.156116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b07eb655-79da-4606-a8ed-183e4d8377d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.191594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b07eb655-79da-4606-a8ed-183e4d8377d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Going to try to stop instance {{(pid=123930) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 05 13:57:27.356090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:27.357114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:27.381628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.386670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b07eb655-79da-4606-a8ed-183e4d8377d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action" status: 202 len: 0 microversion: 2.1 time: 0.243065 May 05 13:57:27.388315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 196/421] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:57:27 2022] POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:57:27.388920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.392005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.394278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.408006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:27.411907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:27.435837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.436933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.438175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.438906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.677394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:27.684846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:27.700115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:27.702798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:27.704870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-08ca1827-1aa2-4c3b-874e-4a33da7649a3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.353248 May 05 13:57:27.705453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 226/422] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:27 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:57:27.707110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed565586-da6a-4ff2-832b-2355610b33ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.312878 May 05 13:57:27.707871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 197/423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:27 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:27.775732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:27.776623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:27.789502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.789960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.791674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:27.792554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:27.953347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'create', calling method: .version_select at 0x7fb4e81984c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1820779916"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:27.953347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for project d2c9372df138414191186d3c950d2e23. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:57:27.957574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for user a07bae627665426fba032d7757685fd1 and project d2c9372df138414191186d3c950d2e23. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:57:27.986674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:27.992685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d891ccfb-41c9-4464-8bea-734ab3ebad02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.221036 May 05 13:57:27.993902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 227/424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:27 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:28.289533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for project d2c9372df138414191186d3c950d2e23. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:57:28.294857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for user a07bae627665426fba032d7757685fd1 and project d2c9372df138414191186d3c950d2e23. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:57:28.315987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fe6883f9-ac19-464a-850d-6a6303550297 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.400428 May 05 13:57:28.317260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 198/425] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 13:57:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:28.426320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1909402082", "imageRef": "a2c2d88d-9b5b-4942-836a-f54fe922767e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1820779916", "networks": [{"uuid": "8c75aba4-dea8-4282-b7fe-0eea287bc686"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:28.725563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:28.726335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:28.735594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:28.736276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:28.737405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:28.738119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:28.909337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:28.919050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:28.921995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:28.923560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3f2ee6de-d269-44a9-965d-e6e59a22b574 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.203854 May 05 13:57:28.924354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 199/426] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:28 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:57:28.929150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:28.930041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:28.937756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:28.938336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:28.939352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:28.939861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:29.101508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:29.112691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0abc8481-e7f4-4c7e-a8cb-356140d68bf7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.187099 May 05 13:57:29.123477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 200/427] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:28 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:29.128084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:29.128697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:29.136308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:29.141370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:29.141370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:29.141370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:29.347315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:29.356270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d53c4b5b-b95d-4d8d-90f9-190e23c84db3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.231805 May 05 13:57:29.357133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 201/428] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:29 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:29.942938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:29.943803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:29.955315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:29.955668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:29.956849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:29.957380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.112327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:30.122458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:30.124065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:30.125187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-61f3320c-72a3-40ce-9254-2a65b35f39c0 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1809 microversion: 2.20 time: 0.186498 May 05 13:57:30.136187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 202/429] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:29 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:57:30.136187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:30.136187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:30.138903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.139302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.140213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.140657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.189619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] validate_networks() for [('8c75aba4-dea8-4282-b7fe-0eea287bc686', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:57:30.396060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:30.404102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d98b7cfa-0d69-49bd-a66e-873c40f055f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.277024 May 05 13:57:30.406796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 203/430] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:30 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:30.414986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:30.418135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:30.426699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.427155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.427929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.428366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.690464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:30.701520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1ab4d109-d44d-4d03-b1e5-d110b63102a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.293922 May 05 13:57:30.704977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 204/431] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:30 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:30.783920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:57:30.784531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:57:30.785494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:57:30.786134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:57:30.787355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:57:30.800510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.801129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.801994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:30.802461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:30.821615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for project d2c9372df138414191186d3c950d2e23. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:57:30.826188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Getting quotas for user a07bae627665426fba032d7757685fd1 and project d2c9372df138414191186d3c950d2e23. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:57:30.839624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:57:30.842281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2c2d88d-9b5b-4942-836a-f54fe922767e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:57:30.965953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d44bea70-4193-4974-87e7-80babe442f47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.543755 May 05 13:57:30.967262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 228/432] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:57:30.978549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-693344ca-7e75-4df5-bf4c-dac600d4e9e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:30.979791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-693344ca-7e75-4df5-bf4c-dac600d4e9e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:31.067415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-693344ca-7e75-4df5-bf4c-dac600d4e9e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.075395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-693344ca-7e75-4df5-bf4c-dac600d4e9e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1259 microversion: 2.1 time: 0.101959 May 05 13:57:31.077244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 205/433] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1259 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:31.145802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:31.147149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:31.158988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.159685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.161207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.161976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.311393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.319927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.329002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.334294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ef543cf8-6192-4757-b3cb-3ebe656a6174 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1796 microversion: 2.20 time: 0.190360 May 05 13:57:31.334294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 229/434] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:57:31 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1796 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:57:31.422558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:31.423348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:31.429749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.430237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.431285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.432440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.583511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.593997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1caacd8d-1437-4305-8cdb-af03380db0c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.175282 May 05 13:57:31.598236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 206/435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:31 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:31.727142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:31.728076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:31.740119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.740775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.741829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:31.742477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:31.894362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:31.902278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8426c218-d0ee-428d-9b32-e08a2d73ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.185664 May 05 13:57:31.903118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 230/436] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:31 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:32.092757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-698881a1-0d20-4fb1-84e8-ca35914af40e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:32.092757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-698881a1-0d20-4fb1-84e8-ca35914af40e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:32.148823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-698881a1-0d20-4fb1-84e8-ca35914af40e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:32.156685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-698881a1-0d20-4fb1-84e8-ca35914af40e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1259 microversion: 2.1 time: 0.068680 May 05 13:57:32.157494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 207/437] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:32.611568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:32.612279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:32.619014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:32.619591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:32.621053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:32.621561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:32.774600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:32.783230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ac980b49-c00b-4624-aed2-716105854c7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.175645 May 05 13:57:32.786322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 231/438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:32 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:32.920822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:32.921442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:32.928224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:32.928694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:32.929479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:32.929927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:33.074505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:33.084127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6e6126b1-9829-49d2-9aeb-7d65669715cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.167072 May 05 13:57:33.085104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 208/439] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:32 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:33.175093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:33.175732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:33.182509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:33.182948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:33.183813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:33.184363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:33.250721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:33.259886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5b085a8-88c0-4e4c-8253-a46df98d88de tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1311 microversion: 2.1 time: 0.089989 May 05 13:57:33.261151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 232/440] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:33.800970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:33.801820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:33.809040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:33.811526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:33.811526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:33.811526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:34.091827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:34.113952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:34.114671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:34.122638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:34.123354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:34.130970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:34.130970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:34.131233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7af80c02-dcfe-4811-bc82-fb694707a067 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.328369 May 05 13:57:34.136635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 209/441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:33 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:34.281561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:34.288111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:34.294448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:34.295665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:34.296373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:34.297013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:34.395091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:34.403471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2500e5a8-ab61-4738-9116-e53d7d2c1b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.304993 May 05 13:57:34.404053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 233/442] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:34 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:34.435712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:34.443140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d5a4109c-faa4-4328-908d-f59d77a14d65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1317 microversion: 2.1 time: 0.169353 May 05 13:57:34.443713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 210/443] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:35.142339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:35.142957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:35.151110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.151805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.154112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.154736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.414478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:35.425991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:35.426827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:35.427083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-197a2592-ad5c-4f0a-972c-b1a75d8f81e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.288041 May 05 13:57:35.427875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 234/444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:35 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:35.440272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.440726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.441521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.441970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.460913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:35.461542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:35.468017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.471401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.471401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:35.471401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:35.722541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:35.730248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1f5b2c1d-4455-4ab2-98c4-594fec088ad1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.311711 May 05 13:57:35.730605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:35.740386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 211/445] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:35 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:35.740574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f70675c1-7291-4c42-b074-09c97130cb0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.282420 May 05 13:57:35.740574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 235/446] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:36.445479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-df69987f-0fad-460d-963b-b2acbb5ad04e req-b3d82461-068b-4c44-bc62-b5922a889a0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:36.446173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:36.446815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:36.469453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.470154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.471753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-df69987f-0fad-460d-963b-b2acbb5ad04e req-b3d82461-068b-4c44-bc62-b5922a889a0f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.472307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-df69987f-0fad-460d-963b-b2acbb5ad04e req-b3d82461-068b-4c44-bc62-b5922a889a0f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.485595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.491215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.503283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-df69987f-0fad-460d-963b-b2acbb5ad04e req-b3d82461-068b-4c44-bc62-b5922a889a0f service nova] Creating event network-changed:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 13:57:36.520015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-df69987f-0fad-460d-963b-b2acbb5ad04e req-b3d82461-068b-4c44-bc62-b5922a889a0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078179 May 05 13:57:36.525604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 212/447] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:57:36.740921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:36.749582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:36.750318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:36.754718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f907f67f-a0bc-4cd5-8d44-23a6041f80fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.313488 May 05 13:57:36.755518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 236/448] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:36 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:36.763624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:36.764957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:36.776896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.777365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.778203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.778351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.780683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.781329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:36.786193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:36.786688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:37.118045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:37.129315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa7d8c80-f30d-4973-9c72-360a55aaf63c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.371435 May 05 13:57:37.146245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 237/449] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:37.185300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:37.204138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d9d2079-892c-42c2-96a9-ac50546b7ca7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.456228 May 05 13:57:37.214315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 213/450] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:36 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:37.772853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:37.773574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:37.780916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:37.781491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:37.782410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:37.782956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:37.949115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:37.959911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67eea3ba-4668-4c0e-9e6e-b1c2c07534dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.190535 May 05 13:57:37.965841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 238/451] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:37 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:38.148394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:38.149049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:38.156233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.156704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:38.157497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.157969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:38.225624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:38.227025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:38.240628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.241634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:38.243392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.244143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:38.340639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:38.349040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-00f77b63-b0d8-49e4-83b1-3c7b1095fe86 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.204602 May 05 13:57:38.350090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 214/452] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:38.418466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:38.426026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b8d436b0-0d29-4d1a-b7f2-eadaa2ef53d2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.205227 May 05 13:57:38.426597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 239/453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:38 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:38.983236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:38.984134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:38.994149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.995454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:38.996465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:38.997270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:39.161062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:39.172530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-944763c3-5771-42ad-980c-edea377747f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.194019 May 05 13:57:39.173118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 215/454] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:38 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:39.367814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:39.368382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:39.376467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:39.377183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:39.378195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:39.378799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:39.443272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:39.443889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:39.450267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:39.450729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:39.451540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:39.452028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:39.551047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:39.559752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5d3cb3d2-ec97-4f8b-974c-ee4bc7c3d1ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.196056 May 05 13:57:39.568902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 240/455] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:39.642789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:39.651853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ee8cb23e-01e7-4fb0-85e9-b0852afc8477 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.210935 May 05 13:57:39.651853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 216/456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:39 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:40.193671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:40.194368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:40.203588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.204042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.205568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.205568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.352347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:40.359867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e18b38d8-eea5-4310-86f0-23e7512661c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.170562 May 05 13:57:40.360372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 241/457] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:40 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:40.577105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:40.578420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:40.585541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.586263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.587199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.587787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.687158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:40.687798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:40.701401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.701911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.702762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:40.703204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:40.773511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:40.782190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65e18812-ed40-42ae-acfb-7b62df0b4713 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.209355 May 05 13:57:40.783014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 217/458] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:40.886960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:40.895872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75f9ad9c-a225-4b45-ba6f-9cb77d3f7553 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.212556 May 05 13:57:40.896900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 242/459] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:40 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:41.377303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:41.377813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:41.383955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.384405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:41.385795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.386265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:41.578572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:41.578572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-236c5903-aee4-4758-b2d2-436ac38e268b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.172404 May 05 13:57:41.578572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 218/460] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:41 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:41.800100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:41.800667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:41.809473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.811181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:41.812167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.812605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:41.913796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:41.914461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:41.922115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.922541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:41.936852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:41.937407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:42.035648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:42.043741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cbcadccb-2b5b-432a-8756-119486432e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.247478 May 05 13:57:42.044684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 243/461] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:42.113007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:42.120900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c52b6729-f1b1-4bb6-abb0-aed2b2714706 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.210905 May 05 13:57:42.121668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 219/462] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:41 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:42.594397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:42.595011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:42.601002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:42.601454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:42.602253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:42.602696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:42.746172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:42.756617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9e6d823a-855c-41b4-ac05-9e38ba4a30c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.165435 May 05 13:57:42.757788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 244/463] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:42 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:43.061399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:43.062125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:43.070552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.070552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.070552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.070552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.138546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:43.139150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:43.146667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.147163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.148078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.148526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.266816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:43.279828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aad6ecfd-ca19-4710-93c9-5cde0d85ee41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.222990 May 05 13:57:43.280525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 220/464] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:43.314956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:43.325672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ba108de1-ceba-4ec1-97f1-3fc4cb208141 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.191446 May 05 13:57:43.326289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 245/465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:43 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:43.776156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:43.776856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:43.783295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.783845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.784803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:43.785300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:43.952694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:43.960841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-17887cc1-78d0-490c-bea4-20a30ba5c5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.188217 May 05 13:57:43.961415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 221/466] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:43 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:44.296731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:44.297432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:44.303960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.304418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:44.307540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.308280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:44.343313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:44.344064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:44.351254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.352526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:44.353062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.353506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:44.511984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:44.520542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5dff3488-d21d-47b0-a8db-bc4f4de9f6e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.227580 May 05 13:57:44.523068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 246/467] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:44.540642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:44.549815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31d63b0e-2d5d-47b4-838d-5a8c07479eb5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.211034 May 05 13:57:44.560141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 222/468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:44 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:44.980977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:44.981854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:44.987921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.988372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:44.989174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:44.989611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:45.127332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:45.135132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-73d7ba2c-9fe7-42ec-b072-ce19aec7d04d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.158056 May 05 13:57:45.135690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 247/469] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:44 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:45.538774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:45.539393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:45.546344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:45.546792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:45.551982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:45.551982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:45.568653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:45.569575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:45.576597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:45.577050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:45.578141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:45.578650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:45.746745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:45.753590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:45.753952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-331eda67-27ce-429d-b698-ad79bbf2edbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.219038 May 05 13:57:45.754613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 223/470] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:45.761577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-19abc83d-c285-44a3-9830-a79123eacbf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.196856 May 05 13:57:45.762209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 248/471] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:45 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:46.152728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:46.153355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:46.159256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.159700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.160452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.160884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.286346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:46.293668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f8c085bb-2bbf-4b10-bbda-c0851dff1b39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1678 microversion: 2.1 time: 0.145311 May 05 13:57:46.294276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 224/472] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:46 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:46.771095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:46.771768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:46.778719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:46.782379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:46.786867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.786867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.786867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.786867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.789527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.790389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.791947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:46.792374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:46.989302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:46.992660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:47.001218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8daff845-c15f-4ac8-9688-1dc2af278867 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.226883 May 05 13:57:47.006173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 225/473] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:46 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:47.008558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ffa5fd52-2554-4751-930f-eaa397398d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.241151 May 05 13:57:47.009131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 249/474] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:47.311452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:47.312068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:47.317985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:47.318491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:47.319239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:47.319713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:47.450301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:47.457806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f125a869-4da4-4f26-ad98-92defb57cb23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1655 microversion: 2.1 time: 0.150850 May 05 13:57:47.458392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 226/475] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:47 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:47.474484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f27a231f-4955-4ee1-b689-199852fe2e54 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:47.480479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27a231f-4955-4ee1-b689-199852fe2e54 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:47.480860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27a231f-4955-4ee1-b689-199852fe2e54 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:47.503122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f27a231f-4955-4ee1-b689-199852fe2e54 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Going to try to start instance {{(pid=123931) start /opt/stack/nova/nova/compute/api.py:2730}} May 05 13:57:47.703122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f27a231f-4955-4ee1-b689-199852fe2e54 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action" status: 202 len: 0 microversion: 2.1 time: 0.231943 May 05 13:57:47.707351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 250/476] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:57:47 2022] POST /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:57:47.712857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:47.713506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:47.719553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:47.720031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:47.721126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:47.721569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:48.019215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:48.020139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:48.027176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:48.027620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:48.028394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:48.028827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:48.038269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:48.046606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fcdd7c66-a633-424c-a63c-e08e3c4c4149 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1664 microversion: 2.1 time: 0.338116 May 05 13:57:48.047175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 227/477] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:47 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1664 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:48.051667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:48.052287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:48.061523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:48.062144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:48.063024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:48.063602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:48.472785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:48.474200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:48.482882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8e22cccc-6ebe-49d9-b0da-1f313dbb2620 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.467948 May 05 13:57:48.483453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-456fb2b3-4363-4bcf-b9a5-aa4715a9a082 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.435195 May 05 13:57:48.483581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 251/478] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:48 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:48.494141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 228/479] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:49.064659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:49.065345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:49.071899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.072639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.073548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.074077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.222346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:49.230323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2ea1f880-8cc9-432e-b213-a83678fdcfd9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1664 microversion: 2.1 time: 0.170121 May 05 13:57:49.230887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 252/480] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:49 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:49.500072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:49.500625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:49.506985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.512240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.512240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.512240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.512816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:49.513436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:49.519271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.519712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.520559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.520992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.711326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:49.715042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:49.719144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8dc37540-011a-49bd-b254-b53d556ce6c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.222853 May 05 13:57:49.719788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 229/481] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:49 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:49.722647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e5e39d9a-307e-4c47-ab11-3d4ea5f04c69 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.214551 May 05 13:57:49.723208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 253/482] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:49.857130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-5fc2845a-e8dc-4991-accf-b16d24d98b1c req-0b2833fc-afe5-45ef-8e60-3cb04b3cf333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "name": "network-vif-plugged", "status": "completed", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:49.865329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-5fc2845a-e8dc-4991-accf-b16d24d98b1c req-0b2833fc-afe5-45ef-8e60-3cb04b3cf333 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:49.865778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-5fc2845a-e8dc-4991-accf-b16d24d98b1c req-0b2833fc-afe5-45ef-8e60-3cb04b3cf333 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:49.877123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-5fc2845a-e8dc-4991-accf-b16d24d98b1c req-0b2833fc-afe5-45ef-8e60-3cb04b3cf333 service nova] Creating event network-vif-plugged:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 13:57:49.882035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-5fc2845a-e8dc-4991-accf-b16d24d98b1c req-0b2833fc-afe5-45ef-8e60-3cb04b3cf333 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029043 May 05 13:57:49.882820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 230/483] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:57:50.246834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:50.247446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:50.256805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.257487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.259069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.259069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.428437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:50.437230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fdb27cd3-0664-4a7d-8249-dcf370f93871 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1668 microversion: 2.1 time: 0.193962 May 05 13:57:50.437811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 254/484] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:50 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1668 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:50.737839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:50.738609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:50.742450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:50.743076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:50.744921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.745381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.746197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.746644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.748951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.749412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.751584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:50.751584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:50.939379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:50.945922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:50.951019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a31ff5a1-ad68-4281-848f-a54365b1e8e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.217871 May 05 13:57:50.951778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 231/485] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:50 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:50.961309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3f2e411c-bde1-4dc4-9977-a43afa4a7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.223018 May 05 13:57:50.961823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 255/486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:51.967510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:51.968128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:51.974936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:51.975394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:51.981236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:51.981236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:51.981656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:51.981656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:51.986845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:51.987301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:51.988286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:51.988713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:52.198314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:52.202230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:52.205995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6f705347-f17b-4e43-8677-7b2c37956ad7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1359 microversion: 2.1 time: 0.230212 May 05 13:57:52.212022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-daa799e3-fbb2-4dfc-adc9-f1837f2c40d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.248298 May 05 13:57:52.212703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 256/487] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:52.214195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 232/488] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:51 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:53.228786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:53.229399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:53.236698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:53.237294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.245034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.245187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:53.245310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.245310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.246945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.247483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.248327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.248836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.434074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:53.437612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:53.443395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-786c36f4-dec0-4761-8140-c1b7362d0a7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1549 microversion: 2.1 time: 0.218429 May 05 13:57:53.444044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 257/489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1549 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:53.445292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7b62b986-6c60-4260-b3d9-062268d12d33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.212308 May 05 13:57:53.445860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 233/490] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:53 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:53.460750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:53.461381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:53.467364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.467811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.468568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.469003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.838499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:53.846389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6440bc38-7c25-4147-bfed-207f76ec6c2a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1549 microversion: 2.1 time: 0.389728 May 05 13:57:53.847022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 258/491] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1549 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:53.867677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:53.871821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:53.872593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Searching by: {'deleted': False, 'project_id': 'd2c9372df138414191186d3c950d2e23'} {{(pid=123930) get_all /opt/stack/nova/nova/compute/api.py:2960}} May 05 13:57:53.879221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.879678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.882220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:53.882220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:53.973843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.multi_cell_list [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123930) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 05 13:57:54.075936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ff575009-523f-400d-9a67-990214393b57 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211981 May 05 13:57:54.076515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 234/492] 10.222.0.26 () {58 vars in 1124 bytes} [Thu May 5 13:57:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:57:54.089016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:54.089896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:54.098711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:54.099390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:54.100570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:54.101426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:54.237289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:54.245800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5a0aa8e-a060-4c1f-9561-b476941a6b3d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1549 microversion: 2.1 time: 0.162938 May 05 13:57:54.246394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 259/493] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:54.466462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:54.467017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:54.474710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:54.475229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:54.476523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:54.476842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:54.611477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:54.618838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e733d8ed-0a96-4bfd-b2cb-10feaa71069b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.156600 May 05 13:57:54.620025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 235/494] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:54 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:55.635407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:55.636054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:55.642460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:55.642912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:55.643670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:55.644107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:55.775815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:55.783115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6883cf40-5fe3-460d-b415-344501f441f9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.151561 May 05 13:57:55.783663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 260/495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:55 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:56.799502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:56.800038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:56.806514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:56.806976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:56.807775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:56.808218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:56.940548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:56.948462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65a13e03-d20e-4699-9055-f13aa3553c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.152408 May 05 13:57:56.949020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 236/496] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:56 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:57.965384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:57.966004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:57.972721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:57.973217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:57.973953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:57.974436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.116692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:58.124136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ddf2ff47-67bc-40cf-9ccf-9b2f90187285 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1501 microversion: 2.1 time: 0.163509 May 05 13:57:58.124695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 261/497] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:57 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:57:58.149915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7601ba-f761-4c23-8e8f-68960954b0b7"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:58.152409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:58.158514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.166167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.166167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.166167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.184194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] HTTP exception thrown: Cannot 'attach_volume' instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 while it is in vm_state rescued May 05 13:57:58.185013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Returning 409 to user: Cannot 'attach_volume' instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 while it is in vm_state rescued {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:57:58.185789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-394955fc-c561-4695-b975-e2aeba501517 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039854 May 05 13:57:58.186537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 237/498] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:57:58 2022] POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 05 13:57:58.202598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:58.203164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:58.210370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.211340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.212275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.212768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.264654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4622437-72cd-4938-ae83-295e54ae151a"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:57:58.265777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:58.271638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.272086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.273007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.273444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.429512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-71eb21fc-9ef3-477f-a16c-374c5b409a48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/action" status: 202 len: 0 microversion: 2.1 time: 0.237781 May 05 13:57:58.430172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 262/499] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:57:58 2022] POST /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:57:58.439145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:58.439765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:58.445954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.446460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.447226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:58.447657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:58.587901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:58.595765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9f8b7635-4f99-41b1-849c-41723815e8e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1509 microversion: 2.1 time: 0.160736 May 05 13:57:58.596545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 263/500] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:58 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:57:59.071039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1aced685-cf3c-42a8-ae4a-c158a50b6d0b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810920 May 05 13:57:59.071772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 238/501] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:57:58 2022] POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:57:59.612972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:57:59.613594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:57:59.620044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:59.620502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:59.621394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:57:59.621885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:57:59.761262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:57:59.769541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31637165-b049-43dd-bcc8-a893f7f09de0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1509 microversion: 2.1 time: 0.160369 May 05 13:57:59.770155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 264/502] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:57:59 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:00.789215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:00.790076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:00.797258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:00.798848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:00.798848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:00.799053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:00.928911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:00.936312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aac1103b-d344-4400-99ae-31b1f64a884e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1509 microversion: 2.1 time: 0.152548 May 05 13:58:00.936927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 239/503] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:00 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:01.952844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:01.953465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:01.959848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:01.960306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:01.961337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:01.961778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:02.097293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:02.108875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7272afe9-76d3-47f5-8d35-d391c581e5fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1509 microversion: 2.1 time: 0.156358 May 05 13:58:02.108875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 265/504] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:01 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:03.123567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:03.124177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:03.131352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:03.131810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:03.132592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:03.133030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:03.262593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:03.269965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2a5b9246-3034-447b-9d83-6a9d81866d95 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1515 microversion: 2.1 time: 0.150218 May 05 13:58:03.270550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 240/505] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:03 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:05.127348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: .version_select at 0x7fb4e81eba60>, body: {"keypair": {"name": "tempest-keypair-648379655"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:05.141754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for project 0054a05e1c0b4300addba50adfb442ef. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:05.145505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for user b10632cbf11b46b2b94afd5df59daa25 and project 0054a05e1c0b4300addba50adfb442ef. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:05.774254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for project 0054a05e1c0b4300addba50adfb442ef. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:05.778082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for user b10632cbf11b46b2b94afd5df59daa25 and project 0054a05e1c0b4300addba50adfb442ef. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:05.794618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-97f3de8c-ca3e-4e61-b4b2-952b83c140fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.670275 May 05 13:58:05.797601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 266/506] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 13:58:05 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:07.498177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:07.499289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:07.505653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.507623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.508366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.508799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.542076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1a49de7a-d2b8-4afa-8f41-9f5405c6eb29 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments/581ce8d7-e3fa-4d36-96d3-f526cbcb7ad3" status: 200 len: 194 microversion: 2.20 time: 0.047972 May 05 13:58:07.543139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 241/507] 10.222.0.26 () {60 vars in 1453 bytes} [Thu May 5 13:58:07 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments/581ce8d7-e3fa-4d36-96d3-f526cbcb7ad3 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:07.609261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:07.609751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:07.616282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.616734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.617547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.617952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.696332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lazy-loading 'services' on Instance uuid df2dfe03-fd03-4632-8c71-c9fcd83a94d7 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:58:07.924752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a101293d-d491-423a-9026-b4e62682bbd3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments/581ce8d7-e3fa-4d36-96d3-f526cbcb7ad3" status: 202 len: 0 microversion: 2.20 time: 0.320250 May 05 13:58:07.925399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 267/508] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 13:58:07 2022] DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments/581ce8d7-e3fa-4d36-96d3-f526cbcb7ad3 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 05 13:58:07.935429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:07.937005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:07.942829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.943287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.944056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:07.944619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:07.954944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-119069545", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbcaa95d-24fb-4fed-89d9-b1cc139d6854"}], "security_groups": [{"name": "tempest-securitygroup--459107585"}], "key_name": "tempest-keypair-648379655", "user_data": "}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:07.975916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-772a5a4b-2258-4bd3-860f-a4d938e292ad tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044348 May 05 13:58:07.976482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 242/509] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:07 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:08.053059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] validate_networks() for [('dbcaa95d-24fb-4fed-89d9-b1cc139d6854', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:58:08.408834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:58:08.409292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:58:08.409778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:58:08.410228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:58:08.410646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:58:08.419262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:08.419713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:08.420532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:08.421611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:08.437755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:08.441599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Getting quotas for user b10632cbf11b46b2b94afd5df59daa25 and project 0054a05e1c0b4300addba50adfb442ef. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:08.452766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:58:08.455099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:58:08.633372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2fb6c7e7-613b-46d6-8b5b-10560851b7e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.682992 May 05 13:58:08.634295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 268/510] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:58:07 2022] POST /compute/v2.1/servers => generated 408 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 05 13:58:08.644642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cee3c161-1019-452d-8aca-2634120ac1ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:08.645252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cee3c161-1019-452d-8aca-2634120ac1ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:08.703408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cee3c161-1019-452d-8aca-2634120ac1ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:08.707174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cee3c161-1019-452d-8aca-2634120ac1ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1244 microversion: 2.1 time: 0.066413 May 05 13:58:08.707771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 243/511] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:08.988630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:08.989678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:08.996458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:08.996914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:08.997684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:08.998154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:09.026420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3c017e28-665e-482c-aa35-6de0c9d853c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041933 May 05 13:58:09.027060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 269/512] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:08 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:09.724340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:09.724873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:09.738154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:09.738687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:09.739454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:09.739890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:09.808246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:09.817405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cd60144e-1061-4257-9bad-fa562a81bd29 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1248 microversion: 2.1 time: 0.097006 May 05 13:58:09.817983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 244/513] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1248 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:10.038676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:10.039660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:10.046779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:10.047226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:10.048021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:10.048454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:10.078674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8e3d5505-5150-46fc-8ea7-cf0973c53972 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044071 May 05 13:58:10.079226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 270/514] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:10 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:10.834205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:10.834815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:10.841685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:10.842158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:10.842942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:10.843467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:10.911055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:10.918321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-837d44cd-8471-4a8d-b96a-18b372526f80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1248 microversion: 2.1 time: 0.087910 May 05 13:58:10.926044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 245/515] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:11.090728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:11.091674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:11.100410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:11.101095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:11.101983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:11.102697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:11.132507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6165bc90-e82f-44d9-b567-d0a5babe4328 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 May 05 13:58:11.133114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 271/516] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:11 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:11.935600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:11.936247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:11.942699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:11.943158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:11.943924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:11.944365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:12.003588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:12.010778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fb678399-b1c4-4f22-9918-f55962248ecd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1248 microversion: 2.1 time: 0.079054 May 05 13:58:12.011340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 246/517] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:12.144328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:12.145248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:12.151534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:12.151983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:12.153052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:12.153490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:12.181923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f4b59862-7e9a-43ac-b069-c728d7234181 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041627 May 05 13:58:12.182508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 272/518] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:12 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:13.027442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:13.028059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:13.035117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:13.035522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:13.036289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:13.036730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:13.096150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:13.103970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6d489c4-87c1-4939-80b2-34e8afc8ee37 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1248 microversion: 2.1 time: 0.080386 May 05 13:58:13.104534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 247/519] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:13.193369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:13.194317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:13.200554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:13.200999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:13.201753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:13.202212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:13.231284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2873ea41-d51b-45f3-858a-66660c5a5b58 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041775 May 05 13:58:13.231816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 273/520] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:13 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:14.119709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:14.120329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:14.127305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:14.127765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:14.128536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:14.128978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:14.190348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:14.197580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cd6c2c18-bab7-410d-b64a-2c6d2db3bc8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1240 microversion: 2.1 time: 0.081692 May 05 13:58:14.198164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 248/521] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:14.243075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:14.243995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:14.250521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:14.251532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:14.252300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:14.252750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:14.281192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-47f3f3f4-dcc7-4cd5-8cf8-70bf91da3a67 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042062 May 05 13:58:14.281666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 274/522] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:14 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:15.035458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:15.036076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:15.041888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.042376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.043134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.043571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.172354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:15.180199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8b55ffd7-a994-4610-871f-e33ead8fc161 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1595 microversion: 2.1 time: 0.149139 May 05 13:58:15.180934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 249/523] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1595 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:15.215215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:15.215889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:15.222313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.222770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.223550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.223996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.285515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:15.292747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:15.292985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0881e1a0-ba06-40e7-bf43-ca5a99ef67bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1296 microversion: 2.1 time: 0.081718 May 05 13:58:15.293392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 275/524] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:15.293736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:15.299836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.300294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.301073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:15.301515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:15.332271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c4231c9-0e29-4b1f-9b6e-9731feec72b6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043387 May 05 13:58:15.332835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 250/525] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:15 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 05 13:58:16.308950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:16.309581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:16.316835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.317442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.318281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.318735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.344456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:16.345545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:16.360674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.361033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.361863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.362374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.403602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9c6abbf2-4022-4c92-b511-1fef1e739fa2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062952 May 05 13:58:16.410191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 251/526] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 13:58:16 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:16.415743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:16.430487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d232819-1209-4605-bcdd-72890ea3dbbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1314 microversion: 2.1 time: 0.125575 May 05 13:58:16.440792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 276/527] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:16.466995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:16.467495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:16.473349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.473828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.474618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.475066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.500197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:58:16.912951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-455b8983-9d90-474d-b03a-707dd6d1ee9f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 204 len: 0 microversion: 2.20 time: 0.449461 May 05 13:58:16.913518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 252/528] 10.222.0.26 () {60 vars in 1279 bytes} [Thu May 5 13:58:16 2022] DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 05 13:58:16.921877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:16.922681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:16.929318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.929769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:16.930581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:16.931019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:17.121102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:17.130539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:17.132210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:17.134320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-853feafe-4685-45ac-b3e8-ec7ea8ef4c9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.215931 May 05 13:58:17.135484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 277/529] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:16 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:17.448716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:17.449329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:17.456697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:17.457144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:17.457908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:17.458369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:17.588415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:17.596377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-95622495-897e-4644-bfe9-5269916bd571 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.151481 May 05 13:58:17.596951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 253/530] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:17.692273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-b23c0a4b-0bdf-4c0a-8023-428b5d83120c req-3f7a5643-b435-46f0-9893-649b33dfc9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:17.704130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b23c0a4b-0bdf-4c0a-8023-428b5d83120c req-3f7a5643-b435-46f0-9893-649b33dfc9a9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:17.704130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b23c0a4b-0bdf-4c0a-8023-428b5d83120c req-3f7a5643-b435-46f0-9893-649b33dfc9a9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:17.720350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-b23c0a4b-0bdf-4c0a-8023-428b5d83120c req-3f7a5643-b435-46f0-9893-649b33dfc9a9 service nova] Creating event network-changed:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 13:58:17.727332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-b23c0a4b-0bdf-4c0a-8023-428b5d83120c req-3f7a5643-b435-46f0-9893-649b33dfc9a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038033 May 05 13:58:17.727332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 278/531] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:18.152768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:18.153384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:18.159871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:18.160324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:18.161085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:18.161531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:18.300588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:18.309097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:18.310708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:18.312149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f8510854-8058-4193-ab3a-4ca6993c86cd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.163322 May 05 13:58:18.312791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 254/532] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:18 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:18.613483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:18.614564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:18.620721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:18.621216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:18.622048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:18.622497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:18.871543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:18.879784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-43c35e96-54a8-45d3-b149-53f8b426a6b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.270723 May 05 13:58:18.880351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 279/533] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:19.332397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:19.333804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:19.341764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:19.342586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:19.343730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:19.344386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:19.570417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:19.579473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:19.581360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:19.586446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc5bb82b-d698-4790-a322-b53191b7827b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1724 microversion: 2.20 time: 0.256477 May 05 13:58:19.586446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 255/534] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:19 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:19.650809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-02dd3004-9f50-4388-914a-3ce5d984bbd0 req-dbdbfa4e-2951-41db-9ca1-e4b95e8a4eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:19.664061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-02dd3004-9f50-4388-914a-3ce5d984bbd0 req-dbdbfa4e-2951-41db-9ca1-e4b95e8a4eee service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:19.665777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-02dd3004-9f50-4388-914a-3ce5d984bbd0 req-dbdbfa4e-2951-41db-9ca1-e4b95e8a4eee service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:19.688023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-02dd3004-9f50-4388-914a-3ce5d984bbd0 req-dbdbfa4e-2951-41db-9ca1-e4b95e8a4eee service nova] Creating event network-changed:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 13:58:19.694926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-02dd3004-9f50-4388-914a-3ce5d984bbd0 req-dbdbfa4e-2951-41db-9ca1-e4b95e8a4eee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047733 May 05 13:58:19.696071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 280/535] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:19.897304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:19.897853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:19.904650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:19.905113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:19.905892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:19.906447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.151625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:20.159399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d9383e12-d191-42b2-a83b-2f1e44def246 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.265970 May 05 13:58:20.162175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 256/536] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:20.540986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-305997473"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:20.543182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:20.550309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:20.550868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.551759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:20.552433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.603548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:20.604865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:20.612772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:20.613265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.614136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:20.614758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.712686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:20.722994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:20.724941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:20.726490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-92212e83-ef20-4280-aa6f-a44dfa760a90 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1656 microversion: 2.20 time: 0.128642 May 05 13:58:20.727612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 257/537] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:20 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1656 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:20.729050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.network.security_group_api [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Adding security group 36763584-850c-4245-b091-dbdb309dd793 to port b70d099e-c754-4a00-8570-a5978889ba6b May 05 13:58:20.813749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-8bd84389-4fde-4e43-8a68-d545dee5bb4b req-c1a3c6ee-2e9f-4902-952a-b0558a60e731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2dfe03-fd03-4632-8c71-c9fcd83a94d7", "name": "network-vif-deleted", "tag": "6c74b632-200d-44de-84ec-4ed466e2500c"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:20.821844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8bd84389-4fde-4e43-8a68-d545dee5bb4b req-c1a3c6ee-2e9f-4902-952a-b0558a60e731 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:20.822370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8bd84389-4fde-4e43-8a68-d545dee5bb4b req-c1a3c6ee-2e9f-4902-952a-b0558a60e731 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:20.835451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-8bd84389-4fde-4e43-8a68-d545dee5bb4b req-c1a3c6ee-2e9f-4902-952a-b0558a60e731 service nova] Creating event network-vif-deleted:6c74b632-200d-44de-84ec-4ed466e2500c for instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 on hv-cinder-73761 May 05 13:58:20.841239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-8bd84389-4fde-4e43-8a68-d545dee5bb4b req-c1a3c6ee-2e9f-4902-952a-b0558a60e731 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031170 May 05 13:58:20.842417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 258/538] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:21.175994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:21.176730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:21.183069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.183523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.184377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.184791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.366990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:21.375615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb5e2d2f-84b8-4897-ad4c-8944ff721907 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.203793 May 05 13:58:21.376356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 259/539] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:21.477730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b9c2d495-4cb0-4d42-9a9f-d0cd1618ffe7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action" status: 202 len: 0 microversion: 2.1 time: 0.941203 May 05 13:58:21.478547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 281/540] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:58:20 2022] POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:58:21.490379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:21.491379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:21.502768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.503303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.503985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.509592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.693575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:21.702709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e536cf8-9ff1-418a-85e9-32372c4c806a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1641 microversion: 2.1 time: 0.216803 May 05 13:58:21.703371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 260/541] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1641 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:21.731203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-86662280-2d43-4bf3-97a4-dceb50423016 req-54f2d0a7-f70e-4a5a-b316-ca1892266f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:21.739819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-86662280-2d43-4bf3-97a4-dceb50423016 req-54f2d0a7-f70e-4a5a-b316-ca1892266f57 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.740274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-86662280-2d43-4bf3-97a4-dceb50423016 req-54f2d0a7-f70e-4a5a-b316-ca1892266f57 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.745302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:21.745948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:21.754381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-86662280-2d43-4bf3-97a4-dceb50423016 req-54f2d0a7-f70e-4a5a-b316-ca1892266f57 service nova] Creating event network-changed:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 13:58:21.760018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-86662280-2d43-4bf3-97a4-dceb50423016 req-54f2d0a7-f70e-4a5a-b316-ca1892266f57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040448 May 05 13:58:21.760202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.760618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.762040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:21.763406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:21.778539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 282/542] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:21.840733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:21.854244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:21.856232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:21.857532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9efbee09-b9f2-422e-b985-79484741e6ac tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1656 microversion: 2.20 time: 0.116550 May 05 13:58:21.858116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 261/543] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:21 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1656 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:22.393669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:22.394402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:22.400573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:22.401021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:22.401783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:22.402247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:22.528711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:22.536179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cb9864a0-591b-4d4a-ae09-1c2d495db1e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.147460 May 05 13:58:22.536987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 283/544] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:22.877686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:22.878364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:22.886654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:22.887378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:22.888318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:22.888924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:23.019254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:23.031747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:23.033872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:23.035259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c95d1a9-c03d-46ba-ba5d-42a0f6da187a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 200 len: 1367 microversion: 2.20 time: 0.162605 May 05 13:58:23.035988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 262/545] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:22 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:23.556198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:23.559073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:23.567663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:23.568495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:23.571448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:23.572475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:23.924770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:23.932419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-53deace7-3e92-407c-b712-050cb14658b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.383431 May 05 13:58:23.932994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 284/546] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:24.053245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:24.053885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:24.060464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:24.060914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:24.061881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:24.062343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:24.077079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. May 05 13:58:24.077667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:58:24.078538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f8ff79a5-f1ac-4c68-8f41-d84ba461cb4d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 404 len: 111 microversion: 2.20 time: 0.029858 May 05 13:58:24.079082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 263/547] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:24 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 13:58:24.088742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65590cf6-b1e5-4f22-a532-f755cc6486f6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '.version_select at 0x7fb4e80b2e50>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:24.187927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-65590cf6-b1e5-4f22-a532-f755cc6486f6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017733230" status: 204 len: 0 microversion: 2.20 time: 0.103794 May 05 13:58:24.188426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 285/548] 10.222.0.26 () {60 vars in 1261 bytes} [Thu May 5 13:58:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017733230 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 05 13:58:24.948947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:24.949561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:24.955452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:24.955904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:24.956667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:24.957108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:25.089616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: .version_select at 0x7fb4e8108820>, body: {"keypair": {"name": "tempest-keypair-1392666370"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:25.107363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:25.112528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:25.114237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:25.122619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2390860c-6206-4bbe-8473-bf319783a701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.177543 May 05 13:58:25.123185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 264/549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:25.420417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:25.424179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:25.436743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9b3f4344-e801-41e0-8539-b15e243d3084 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.351785 May 05 13:58:25.437328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 286/550] 10.222.0.26 () {62 vars in 1198 bytes} [Thu May 5 13:58:25 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 353 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 05 13:58:26.139890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:26.140540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:26.147076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:26.147468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:26.148234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:26.148701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:26.277874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:26.285731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-85610361-1793-40ac-ad9c-c95d446eca3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.149771 May 05 13:58:26.286326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 265/551] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:27.303259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:27.303888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:27.311795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:27.312259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:27.313292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:27.313711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:27.449494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:27.457364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1822e892-82f5-4ec3-8f66-329eb9e836e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.158970 May 05 13:58:27.457932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 287/552] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:28.004672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-441494317", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8df3eb2-04a6-4bb2-b7d0-c50b1c1096b0"}], "security_groups": [{"name": "tempest-securitygroup--937472867"}], "key_name": "tempest-keypair-1392666370", "user_data": "}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:28.103136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] validate_networks() for [('b8df3eb2-04a6-4bb2-b7d0-c50b1c1096b0', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:58:28.461306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:58:28.461992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:58:28.462504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:58:28.462954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:58:28.463561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:58:28.473059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:28.473544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:28.474392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:28.474833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:28.474999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:28.475609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:28.481989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:28.482468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:28.483306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:28.483744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:28.492057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for project 8536ba08456944f5a554574f98c72fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:28.495976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Getting quotas for user add9c19abc0a46feb0be090a9a6641c1 and project 8536ba08456944f5a554574f98c72fb2. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:28.511908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:58:28.514225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:58:28.615222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:28.622885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7c2de524-b241-4195-a260-9b303717e6df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.152539 May 05 13:58:28.623450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 288/553] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:28.673959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed685833-307a-4084-a2cc-59832b093cea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.674357 May 05 13:58:28.674691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 266/554] 10.222.0.26 () {62 vars in 1187 bytes} [Thu May 5 13:58:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 05 13:58:28.684851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:28.685746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:28.749949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:28.757194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:28.758732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:28.759912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1685b215-2110-43e4-bc3c-d4e661f0fe5b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1281 microversion: 2.20 time: 0.079052 May 05 13:58:28.760446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 289/555] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:28 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:28.991848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-43a625a4-f8de-4409-a97f-60b1e4f077ff req-31353398-add3-4443-b995-e7a7c37e3043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "name": "network-vif-plugged", "status": "completed", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:29.003075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-43a625a4-f8de-4409-a97f-60b1e4f077ff req-31353398-add3-4443-b995-e7a7c37e3043 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:29.003605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-43a625a4-f8de-4409-a97f-60b1e4f077ff req-31353398-add3-4443-b995-e7a7c37e3043 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:29.014564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-43a625a4-f8de-4409-a97f-60b1e4f077ff req-31353398-add3-4443-b995-e7a7c37e3043 service nova] Creating event network-vif-plugged:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 13:58:29.022667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-43a625a4-f8de-4409-a97f-60b1e4f077ff req-31353398-add3-4443-b995-e7a7c37e3043 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032290 May 05 13:58:29.022667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 267/556] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:29.639357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:29.639972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:29.651349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:29.651349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:29.651349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:29.651349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:29.778661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:29.779372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:29.780367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:29.786215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:29.786671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:29.787452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:29.787899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:29.790053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-335b2c2d-dad7-4b57-96e0-d567794ff5ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.154367 May 05 13:58:29.790730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 290/557] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:29.851043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:29.860217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:29.863074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:29.863715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0cac621f-3935-45b7-95f5-68a0a19eab5c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1285 microversion: 2.20 time: 0.089523 May 05 13:58:29.864496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 268/558] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:29 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:30.807071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:30.807772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:30.814883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:30.815497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:30.816404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:30.816892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:30.881256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:30.882050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:30.888701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:30.889236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:30.890110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:30.890626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:30.958657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:30.966860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:30.968415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:30.969722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c3da026c-18db-48c0-af75-0f1a2c871777 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1333 microversion: 2.20 time: 0.092903 May 05 13:58:30.973892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 269/559] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:30 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:30.977573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:30.985311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4d020931-dd35-4b37-abba-a837e8a68a09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1369 microversion: 2.1 time: 0.181967 May 05 13:58:30.986608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 291/560] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:31.988395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:31.989016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:31.995518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:31.996222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:31.999332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:31.999949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:32.004981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:32.005606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:32.016312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:32.016797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:32.018272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:32.018718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:32.093798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:32.102785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:32.105123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:32.106198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e9b94790-b4c4-45e7-85cc-cb8cb6ffd0e3 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1341 microversion: 2.20 time: 0.122388 May 05 13:58:32.106752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 270/561] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:31 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1341 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:32.251806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:32.259644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-54290bac-e363-4d7e-9e98-96ac7deb6595 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1562 microversion: 2.1 time: 0.259984 May 05 13:58:32.260662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 292/562] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1562 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:32.276101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:32.276596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:32.282798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:32.283911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:32.284685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:32.285132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:32.361980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e9f2c202-f91e-4594-89ae-7d92ad1418c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089458 May 05 13:58:32.362601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 271/563] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 13:58:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:58:33.128334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:33.129547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:33.135909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:33.136365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:33.137150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:33.137761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:33.326878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:33.336841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:33.338663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:33.339839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-59ecd1e4-1213-4f30-8f37-14ff3eb5732b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.219019 May 05 13:58:33.340400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 293/564] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:33 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:33.521035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-6ff2f76e-03ce-4348-8c29-bd1cb814936a req-9dc89ac4-995c-43fa-b355-c614cb3932ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:33.531310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-6ff2f76e-03ce-4348-8c29-bd1cb814936a req-9dc89ac4-995c-43fa-b355-c614cb3932ac service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:33.531310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-6ff2f76e-03ce-4348-8c29-bd1cb814936a req-9dc89ac4-995c-43fa-b355-c614cb3932ac service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:33.539920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-6ff2f76e-03ce-4348-8c29-bd1cb814936a req-9dc89ac4-995c-43fa-b355-c614cb3932ac service nova] Creating event network-changed:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 13:58:33.545337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-6ff2f76e-03ce-4348-8c29-bd1cb814936a req-9dc89ac4-995c-43fa-b355-c614cb3932ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033353 May 05 13:58:33.550496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 272/565] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:33.970330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-31371061-6c90-48f2-b652-a92ff24b3c93 req-5d9407b8-2b31-4321-9747-a31ab6bfb235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:33.978891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-31371061-6c90-48f2-b652-a92ff24b3c93 req-5d9407b8-2b31-4321-9747-a31ab6bfb235 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:33.979790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-31371061-6c90-48f2-b652-a92ff24b3c93 req-5d9407b8-2b31-4321-9747-a31ab6bfb235 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:33.990642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-31371061-6c90-48f2-b652-a92ff24b3c93 req-5d9407b8-2b31-4321-9747-a31ab6bfb235 service nova] Creating event network-changed:eda82bc2-7da3-440e-8aee-53635c08bbe1 for instance 93818186-77bc-406b-8664-b67f320534c5 on hv-cinder-73761 May 05 13:58:34.000455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-31371061-6c90-48f2-b652-a92ff24b3c93 req-5d9407b8-2b31-4321-9747-a31ab6bfb235 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033831 May 05 13:58:34.001069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 294/566] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:34.360397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:34.361299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:34.368076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:34.368670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:34.369690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:34.370425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:34.686351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1990338849", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "networks": [{"uuid": "5159c019-65a1-4795-a9bf-2254a47f332a"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:34.713459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:34.723119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:34.725259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:34.727281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-82e608b5-2724-40cd-aed7-d751295d10cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.371542 May 05 13:58:34.727835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 273/567] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:34 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:34.742187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] validate_networks() for [('5159c019-65a1-4795-a9bf-2254a47f332a', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:58:35.317417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:58:35.317847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:58:35.318356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:58:35.318771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:58:35.319445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:58:35.328512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:35.328952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:35.329786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:35.330881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:35.347741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Getting quotas for project fc26737fc8c745fa952abfd840bf9278. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:35.351685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Getting quotas for user baf7c7226e1747f397783c8d4429f601 and project fc26737fc8c745fa952abfd840bf9278. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:35.363539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:58:35.365619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:58:35.531179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e996618-49ca-44ff-a862-100d99c46e32 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849135 May 05 13:58:35.531826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 295/568] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:58:35.542414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a038dd68-b942-4ad0-bfed-d97b5a100947 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:35.543175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a038dd68-b942-4ad0-bfed-d97b5a100947 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:35.599906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a038dd68-b942-4ad0-bfed-d97b5a100947 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:35.606485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a038dd68-b942-4ad0-bfed-d97b5a100947 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1219 microversion: 2.1 time: 0.068647 May 05 13:58:35.607045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 274/569] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:35 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:35.747484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:35.748099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:35.755305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:35.755759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:35.756623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:35.757099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:35.888488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:35.896315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:35.897822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:35.898958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4f059eaa-e1a4-42a3-aacc-68f9ee212abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.155933 May 05 13:58:35.899524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 296/570] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:35 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:36.623613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:36.624284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:36.631790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:36.632712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:36.632998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:36.633437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:36.697298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:36.704630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83f265cf-1600-4979-8376-9e13b19d6d35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1223 microversion: 2.1 time: 0.084887 May 05 13:58:36.705756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 275/571] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:36 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:36.916476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:36.917126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:36.923439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:36.924393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:36.925193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:36.925590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:37.066161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:37.075126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:37.077003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:37.078150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3518bf4f-bda4-4385-8fe3-fbfaaa84d852 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.165496 May 05 13:58:37.078715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 297/572] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:36 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:37.722269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:37.722944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:37.729254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:37.729700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:37.730490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:37.730924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:37.801090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:37.809188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76ea1e42-1bcd-41bb-a50d-9109350ae923 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1279 microversion: 2.1 time: 0.090673 May 05 13:58:37.810051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 276/573] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:37 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:38.095611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:38.100603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:38.103592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:38.104210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:38.105176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:38.105616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:38.293764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:38.302237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:38.303724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:38.304861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-52b3f0e5-0eee-4ee6-8cd7-4c6507a32be4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.213164 May 05 13:58:38.305403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 298/574] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:38 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:38.827731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:38.828994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:38.836127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:38.836576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:38.837606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:38.838064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:39.046640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:39.054089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9aa0b76e-42b9-40ad-b857-45399043c286 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.230286 May 05 13:58:39.055025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 277/575] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:38 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:39.323361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:39.324033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:39.330395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:39.330852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:39.331624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:39.332066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:39.459973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:39.468657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:39.470228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:39.471720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e84941e8-26da-4e18-a549-4c9f45f39541 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.151896 May 05 13:58:39.472476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 299/576] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:39 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:39.507025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-cfff082f-3d1f-42c3-9af1-b50176e25c63 req-47eeadb6-3022-4d90-80c7-ba03d8c7e5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6b7169b-ef8f-47d8-8aff-900814648280", "tag": "7d30db89-bf1d-41f5-b5c9-79958f87c913"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:39.515070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-cfff082f-3d1f-42c3-9af1-b50176e25c63 req-47eeadb6-3022-4d90-80c7-ba03d8c7e5f6 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:39.515587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-cfff082f-3d1f-42c3-9af1-b50176e25c63 req-47eeadb6-3022-4d90-80c7-ba03d8c7e5f6 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:39.526053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-cfff082f-3d1f-42c3-9af1-b50176e25c63 req-47eeadb6-3022-4d90-80c7-ba03d8c7e5f6 service nova] Creating event network-changed:7d30db89-bf1d-41f5-b5c9-79958f87c913 for instance b6b7169b-ef8f-47d8-8aff-900814648280 on hv-cinder-73761 May 05 13:58:39.530897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-cfff082f-3d1f-42c3-9af1-b50176e25c63 req-47eeadb6-3022-4d90-80c7-ba03d8c7e5f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028167 May 05 13:58:39.532168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 278/577] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:58:40.071515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:40.072143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:40.078156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:40.078624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:40.079427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:40.079900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:40.278684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:40.286917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0d3c2a82-0203-40cb-8e57-2de184c303ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.219438 May 05 13:58:40.287482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 300/578] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:40 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:40.491139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:40.491759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:40.498070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:40.498526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:40.503392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:40.503392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:40.627453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:40.635771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:40.637302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:40.638429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a94f3fc0-78b2-48a1-8fdd-e964cd0d2ccc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.152190 May 05 13:58:40.638993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 279/579] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:40 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:40.949650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-16ab4998-adfb-4922-b73a-b70a583cbe22 req-8761bbeb-4992-4517-9318-1c65106036a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "name": "network-vif-plugged", "status": "completed", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:40.957905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-16ab4998-adfb-4922-b73a-b70a583cbe22 req-8761bbeb-4992-4517-9318-1c65106036a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:40.958379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-16ab4998-adfb-4922-b73a-b70a583cbe22 req-8761bbeb-4992-4517-9318-1c65106036a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:40.969311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-16ab4998-adfb-4922-b73a-b70a583cbe22 req-8761bbeb-4992-4517-9318-1c65106036a7 service nova] Creating event network-vif-plugged:eda82bc2-7da3-440e-8aee-53635c08bbe1 for instance 93818186-77bc-406b-8664-b67f320534c5 on hv-cinder-73761 May 05 13:58:40.974506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-16ab4998-adfb-4922-b73a-b70a583cbe22 req-8761bbeb-4992-4517-9318-1c65106036a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028338 May 05 13:58:40.975074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 301/580] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:41.303503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:41.304118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:41.310126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.310589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.311350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.311837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.440942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:41.448996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fb58fbc4-510b-4303-8fe2-2a78a79fb3d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.149797 May 05 13:58:41.449868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 280/581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:41 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:41.494286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:41.495315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:41.501439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.508267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.508267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.508267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.531491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c2fa95b-dc14-42c2-b7cf-fa78d2687907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041447 May 05 13:58:41.532043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 302/582] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 13:58:41 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 05 13:58:41.589580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:41.590141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:41.596550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.600100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.600100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.600100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.624134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:58:41.656818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:41.657563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:41.664128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.664613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.665361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.665802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.844138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:41.853167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:41.854678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:41.855772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-54a856a5-6e21-46d4-9c4c-bdcb4b9ce91d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.202988 May 05 13:58:41.856316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 303/583] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:41 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:41.923703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-412206c4-c84a-4e6a-b602-7989e508faa8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 204 len: 0 microversion: 2.1 time: 0.338016 May 05 13:58:41.924281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 281/584] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:58:41 2022] DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:58:41.932235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:41.932855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:41.938823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.939278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:41.940047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:41.940498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.069520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:42.076875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-89cdc1ba-51d3-422e-8624-56388e22a75d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1674 microversion: 2.1 time: 0.148408 May 05 13:58:42.077427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 304/585] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:41 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:42.239379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:42.240417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:42.246691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.247143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.247914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.248355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.440488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2b941aa1-7fb4-4286-9764-4e2d598b919c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action" status: 202 len: 0 microversion: 2.1 time: 0.205181 May 05 13:58:42.441723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 282/586] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:58:42 2022] POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:58:42.449582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:42.450347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:42.456207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.456656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.457415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.457854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.466432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:42.467137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:42.473456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.473954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.474830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.475269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.655564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:42.663230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f844a5ab-9cc2-4d33-93b2-68667915eadc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.201076 May 05 13:58:42.663795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 283/587] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:42 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:42.665325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:42.673351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-de4a9703-4518-4df4-8801-0701b9a8fdb3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1752 microversion: 2.1 time: 0.227634 May 05 13:58:42.673895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 305/588] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:42.872763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:42.873372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:42.879269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.879722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:42.880487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:42.880921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.008211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.016337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.017820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.018952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b56bb39a-6d77-40e4-885c-72528b4be16d tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.150173 May 05 13:58:43.019528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 284/589] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:42 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:43.094990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:43.095785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:43.102783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.103227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.103994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.104748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.241091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.249243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e45b5572-374d-4ebf-9ae2-a8b0838f8e5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1674 microversion: 2.1 time: 0.158057 May 05 13:58:43.249823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 306/590] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:43 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:43.682219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:43.682837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:43.689377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.696735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.696735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.696952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:43.697057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.697166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:43.698094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.698551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.699323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:43.699766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:43.881383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.888620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51484e01-d5af-4813-aa0e-848c617dbcd7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.210310 May 05 13:58:43.889197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 285/591] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:43 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:43.895015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:43.903351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f17c15a4-8bff-4b04-8466-69113d8ef8a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1752 microversion: 2.1 time: 0.216154 May 05 13:58:43.903908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 307/592] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:44.036427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:44.036969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:44.042877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.043332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.044096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.044541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.170090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:44.178412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:44.179924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:44.181013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8ccf04e3-5a98-496d-8e7b-4cc65b272c5a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.148525 May 05 13:58:44.181570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 286/593] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:44 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:44.266717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:44.267328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:44.273818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.274304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.275068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.275543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.400466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:44.407708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76df120e-b25f-4f59-84c0-37e18e737ba4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1674 microversion: 2.1 time: 0.144922 May 05 13:58:44.408261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 308/594] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:44 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:44.906417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:44.907041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:44.915962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.916422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.917303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.917688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.922496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:44.923333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:44.929903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.930481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:44.931534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:44.932592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.132741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.140496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-47311467-896c-4f60-938c-7669211d97cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.239494 May 05 13:58:45.141050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 287/595] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:44 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:45.146781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-c403c2f2-7ae6-4625-9bfb-e80a910ec82f req-2939d8f8-af04-4316-8147-0c728222a6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7169b-ef8f-47d8-8aff-900814648280", "name": "network-vif-plugged", "status": "completed", "tag": "7d30db89-bf1d-41f5-b5c9-79958f87c913"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:45.154618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-c403c2f2-7ae6-4625-9bfb-e80a910ec82f req-2939d8f8-af04-4316-8147-0c728222a6c2 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:45.155056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-c403c2f2-7ae6-4625-9bfb-e80a910ec82f req-2939d8f8-af04-4316-8147-0c728222a6c2 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.165995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-c403c2f2-7ae6-4625-9bfb-e80a910ec82f req-2939d8f8-af04-4316-8147-0c728222a6c2 service nova] Creating event network-vif-plugged:7d30db89-bf1d-41f5-b5c9-79958f87c913 for instance b6b7169b-ef8f-47d8-8aff-900814648280 on hv-cinder-73761 May 05 13:58:45.167763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.171130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-c403c2f2-7ae6-4625-9bfb-e80a910ec82f req-2939d8f8-af04-4316-8147-0c728222a6c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028808 May 05 13:58:45.171720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 288/596] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:45.178806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4c051a26-fd22-44e3-98c9-dfacb525d170 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1752 microversion: 2.1 time: 0.259219 May 05 13:58:45.178806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 309/597] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:45.199623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:45.200385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:45.206555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:45.207001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.207757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:45.208185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.345762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.353931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.355452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.356543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c8bc45c-9083-4d38-b27f-269295e97dab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1406 microversion: 2.20 time: 0.161069 May 05 13:58:45.357100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 289/598] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:45 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:58:45.425314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:45.428300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:45.432426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:45.432859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.433635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:45.434109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:45.970642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:45.978633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f3c8122e-0b6d-421e-a055-52dc3ef00e7b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1674 microversion: 2.1 time: 0.557161 May 05 13:58:45.979205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 310/599] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:45 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1674 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:46.157816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:46.158459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:46.165330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.165780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.166569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.167008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.193729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:46.194394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:46.200913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.201369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.202361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.202823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.495451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:46.503153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4b8bef8a-c19d-45d8-8eef-d3b538c1bf6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.349210 May 05 13:58:46.503725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 290/600] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:46 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:46.510876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:46.516191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:46.517025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:46.521565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e507c69-92e6-4af5-bc48-305cc63bd02c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1752 microversion: 2.1 time: 0.331386 May 05 13:58:46.522425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 311/601] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1752 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:46.523927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.524383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.525155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.525595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.706084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:46.714760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:46.716257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:46.717410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b87c94ed-1eb4-49c0-a5a3-5d44e7dd204a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1597 microversion: 2.20 time: 0.212781 May 05 13:58:46.717967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 291/602] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:58:46 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1597 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:58:46.734719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:46.735218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:46.741215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.741667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.742461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:46.742898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:46.885495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4a6e5ef3-ee31-42fa-8cd7-18fbed1404e6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.154551 May 05 13:58:46.886127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 312/603] 10.222.0.26 () {60 vars in 1315 bytes} [Thu May 5 13:58:46 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:58:46.996943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:46.997569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:47.004428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.005057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.006734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.007926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.093294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:47.115755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d60b76fd-d472-40ee-95ec-0c7aeb7f0945 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1607 microversion: 2.1 time: 0.123736 May 05 13:58:47.116648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 292/604] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:46 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1607 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:47.235068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-e2a8f4cf-1c68-471f-a0e0-6409a7766c8d req-5fd5ba54-df13-468f-853a-942dd6066f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09aa3778-4ca9-460b-a8b8-8ecb90e011d2", "name": "network-vif-deleted", "tag": "ad02117d-5482-4c80-9eec-a65489232708"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:47.246128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-e2a8f4cf-1c68-471f-a0e0-6409a7766c8d req-5fd5ba54-df13-468f-853a-942dd6066f90 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.246969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-e2a8f4cf-1c68-471f-a0e0-6409a7766c8d req-5fd5ba54-df13-468f-853a-942dd6066f90 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.261930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-e2a8f4cf-1c68-471f-a0e0-6409a7766c8d req-5fd5ba54-df13-468f-853a-942dd6066f90 service nova] Creating event network-vif-deleted:ad02117d-5482-4c80-9eec-a65489232708 for instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 on hv-cinder-73761 May 05 13:58:47.267700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-e2a8f4cf-1c68-471f-a0e0-6409a7766c8d req-5fd5ba54-df13-468f-853a-942dd6066f90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036424 May 05 13:58:47.268710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 313/605] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:47.520180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:47.521594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:47.528665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.529494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.530531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.531213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.539933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:47.541328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:47.559213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.560194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.561854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:47.562534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:47.782719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:47.792766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f488077-68ed-4bc7-97ca-1161bcd8a9d0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1319 microversion: 2.1 time: 0.276427 May 05 13:58:47.803160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:47.806179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 293/606] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:47 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:47.812995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-81f4376e-2d33-43b1-9045-d4179bf6a0e2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1752 microversion: 2.1 time: 0.277580 May 05 13:58:47.814908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 314/607] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1752 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:48.133312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:48.133935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:48.140538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.140994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.141770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.142243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.175477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.175930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.176389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'fault' on Instance uuid 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:58:48.226957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:48.235803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0030634c-3bbb-4ea7-b1b7-fc53c893ccd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 200 len: 1328 microversion: 2.1 time: 0.106812 May 05 13:58:48.237823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 294/608] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:48 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:48.373456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-75a71d6c-32d6-4f3d-8fa9-3210971f733e req-50c8c4ad-11e5-44da-9956-b7f8c93c5b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:48.373456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-75a71d6c-32d6-4f3d-8fa9-3210971f733e req-50c8c4ad-11e5-44da-9956-b7f8c93c5b8f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.373456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-75a71d6c-32d6-4f3d-8fa9-3210971f733e req-50c8c4ad-11e5-44da-9956-b7f8c93c5b8f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.373456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-75a71d6c-32d6-4f3d-8fa9-3210971f733e req-50c8c4ad-11e5-44da-9956-b7f8c93c5b8f service nova] Creating event network-changed:eda82bc2-7da3-440e-8aee-53635c08bbe1 for instance 93818186-77bc-406b-8664-b67f320534c5 on hv-cinder-73761 May 05 13:58:48.374543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-75a71d6c-32d6-4f3d-8fa9-3210971f733e req-50c8c4ad-11e5-44da-9956-b7f8c93c5b8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032064 May 05 13:58:48.374543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 315/609] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:48.811301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:48.811916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:48.819632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.820357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.821451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.822058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.834551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:48.836382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:48.844050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.844811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:48.845914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:48.846584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:49.053146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:49.063556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b9336603-c457-45f5-af94-e295af4d07b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1509 microversion: 2.1 time: 0.256628 May 05 13:58:49.064340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 295/610] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:48 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:49.068238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:49.076739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3df876f8-56cd-4fe0-aad3-91c2e2c6d393 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.246979 May 05 13:58:49.090988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 316/611] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:49.252425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:49.257431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:49.268319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:49.268778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:49.269559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:49.270373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:49.284685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. May 05 13:58:49.285500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 404 to user: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:58:49.286401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-def7ae6e-5aae-4b58-9b07-0c02f2868286 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 404 len: 111 microversion: 2.1 time: 0.037682 May 05 13:58:49.286946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 296/612] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:49 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:58:49.295253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-23efd962-149a-439b-b281-0be4fa8a3248 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '.version_select at 0x7fb4e80c8670>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:49.387685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-23efd962-149a-439b-b281-0be4fa8a3248 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382990044" status: 202 len: 0 microversion: 2.1 time: 0.096156 May 05 13:58:49.388278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 317/613] 10.222.0.26 () {58 vars in 1220 bytes} [Thu May 5 13:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382990044 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:58:50.100368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:50.101712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:50.108504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:50.109043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:50.109934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:50.110488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:50.153834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: .version_select at 0x7fb4e8082940>, body: {"keypair": {"name": "tempest-keypair-1679087716"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:50.168196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:50.171990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:50.259229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:50.269304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c6782d57-122e-4ccb-8f23-3ebc34b8bd5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.174330 May 05 13:58:50.270036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 297/614] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:50.544661 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:50.548296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:50.561151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-15139e6b-c3d0-49f8-9a65-9b9713a3134e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.417352 May 05 13:58:50.561744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 318/615] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 13:58:50 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:50.881381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:50.882133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:50.889004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:50.889457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:50.890267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:50.890708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:50.914039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lazy-loading 'flavor' on Instance uuid 3c3e07b2-6689-45b9-9da1-000c29490f34 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:58:51.202907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4aa2dc2f-d368-46b0-9ca7-36cca14926a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "POST /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34/action" status: 202 len: 0 microversion: 2.1 time: 0.326060 May 05 13:58:51.203583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 298/616] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:58:50 2022] POST /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:58:51.213247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:51.214882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:51.222864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:51.223379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:51.224211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:51.224676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:51.287153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:51.288036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:51.300494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:51.300494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:51.301202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:51.301834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:51.382880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:51.390442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e8179e74-9e96-458a-8836-2d2f0b25a473 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.182468 May 05 13:58:51.391135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 319/617] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:51 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:51.480954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:51.488869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a29eee6-68e0-44a2-b2b0-96c26383de95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.205876 May 05 13:58:51.489627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 299/618] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:52.408498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:52.409053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:52.416313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:52.418475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:52.418475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:52.418475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:52.507142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:52.507761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:52.517264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:52.517727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:52.518549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:52.518984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:52.555793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:52.563529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a65573c-2716-4f1d-96c7-2dac3d8cb14a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.159352 May 05 13:58:52.564096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 320/619] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:52 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:52.672706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:52.680684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-deacfb8d-0917-46a2-925e-6cd68742aa07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.178073 May 05 13:58:52.688958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 300/620] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:52.872710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1905885279", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0b291d6-4191-476b-9202-167169caeaa6"}], "security_groups": [{"name": "tempest-securitygroup--524492816"}], "key_name": "tempest-keypair-1679087716", "user_data": "}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:52.969052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] validate_networks() for [('e0b291d6-4191-476b-9202-167169caeaa6', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:58:53.343455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:58:53.343882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:58:53.344357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:58:53.344768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:58:53.345180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:58:53.354298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.354752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.355583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.356021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.372892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:58:53.376808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Getting quotas for user 3337cd0a90cb4d72b093f6a912295125 and project b3c2d40011044e5d86c205f3cf09d56e. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:58:53.389077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:58:53.391495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:58:53.521285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-14a7318c-a537-4fd0-bf59-961c435391ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652630 May 05 13:58:53.526609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 321/621] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:58:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:58:53.532054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a7ed8861-cc4c-4c01-b09d-ab49c0c0f3a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:53.532763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a7ed8861-cc4c-4c01-b09d-ab49c0c0f3a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:53.581048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:53.581805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:53.590432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.591238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.591515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.591956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.593084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a7ed8861-cc4c-4c01-b09d-ab49c0c0f3a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:53.601124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a7ed8861-cc4c-4c01-b09d-ab49c0c0f3a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1238 microversion: 2.1 time: 0.072897 May 05 13:58:53.602159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 301/622] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:53.696820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:53.699829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:53.703940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.704403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.705156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:53.705590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:53.737528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:53.745176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-747d672f-3022-48e0-babb-c2e6424206c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.168099 May 05 13:58:53.745755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 322/623] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:53 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:53.853907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:53.861687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-883adddd-f1e7-4bff-8d85-bf90f4b73aca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.168973 May 05 13:58:53.862290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 302/624] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:54.618884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:54.619452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:54.635110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.635570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.644084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.644084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.704398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:54.711793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3b3ba3ff-49fd-40aa-9799-9ed5c0e8fb25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1242 microversion: 2.1 time: 0.097463 May 05 13:58:54.712610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 323/625] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:54.762954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:54.763680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:54.770118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.770829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.771755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.772194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.878821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:54.879400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:54.885989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.886625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.887402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:54.887848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:54.910285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:54.920312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-233212e6-542e-460a-a602-b3e3e85408dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.161161 May 05 13:58:54.920902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 303/626] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:54 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:55.037482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:55.045683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2ed4efee-8702-47e5-aa04-71fc52403bd2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.170929 May 05 13:58:55.046286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 324/627] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:55.729490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:55.730158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:55.737785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:55.738269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:55.739051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:55.739493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:55.804017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:55.811416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4c3d723-43e5-4e86-90e9-71db3ad5bf22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1308 microversion: 2.1 time: 0.085990 May 05 13:58:55.811976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 304/628] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:55.938494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:55.939275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:55.946306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:55.946751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:55.947519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:55.947951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:56.062362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:56.062890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:56.069919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:56.070409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:56.071194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:56.071637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:56.465432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:56.472780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8ec67561-d122-4e21-bbfe-dba344bba89a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.538763 May 05 13:58:56.473353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 325/629] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:55 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:56.481051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:56.492976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c112220a-aeeb-423e-97c7-1a612001ed95 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.434117 May 05 13:58:56.493227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 305/630] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:56.829132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:56.829753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:56.836872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:56.837912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:56.839060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:56.839658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.097106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:57.105908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5b92ed89-d9ac-4683-856a-b1fb3eef8350 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.280143 May 05 13:58:57.106046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 326/631] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:57.491985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:57.492616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:57.499646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:57.500109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.500993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:57.501326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.510773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:57.511752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:57.520851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:57.522205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.523207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:57.523873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.773411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:57.781382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a096276b-8f7a-405a-8858-67819c4dc181 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.293261 May 05 13:58:57.782683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 306/632] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:57 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:57.800691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-5cc2ab8c-62d9-4285-af7f-343bb5f65120 req-46da2a3c-8eec-44fd-a01a-ebd301f5bb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a900c1d4-5ad8-4465-9f93-b1263bd89f66", "tag": "9552713a-7887-402b-80fe-83abd608be5c"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:58:57.804870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:57.809845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-5cc2ab8c-62d9-4285-af7f-343bb5f65120 req-46da2a3c-8eec-44fd-a01a-ebd301f5bb10 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:57.813682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-5cc2ab8c-62d9-4285-af7f-343bb5f65120 req-46da2a3c-8eec-44fd-a01a-ebd301f5bb10 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:57.820799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4f18935b-cb81-445c-876c-c1b9770dc05f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.315374 May 05 13:58:57.826951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-5cc2ab8c-62d9-4285-af7f-343bb5f65120 req-46da2a3c-8eec-44fd-a01a-ebd301f5bb10 service nova] Creating event network-changed:9552713a-7887-402b-80fe-83abd608be5c for instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 on hv-cinder-73761 May 05 13:58:57.834773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 327/633] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:57.834960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-5cc2ab8c-62d9-4285-af7f-343bb5f65120 req-46da2a3c-8eec-44fd-a01a-ebd301f5bb10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037104 May 05 13:58:57.835528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 307/634] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:58:58.122811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:58.123434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:58.129800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.130281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.131537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.131972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.294426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:58.301610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cbd0cf67-3718-4a3c-b759-e54cda3c0a4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.182623 May 05 13:58:58.302702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 328/635] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:58.802059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:58.802682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:58.808866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.809343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.810095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.810530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.839618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:58.840241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:58.846319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.846776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.847547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:58.847987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:58.993235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:59.000861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-78585fd7-93c4-4e69-bbf9-85100e48d4eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.203756 May 05 13:58:59.001430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 308/636] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:58 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:58:59.033084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:59.041059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7a5f17ee-7f52-47e7-acdd-7a96083b4de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.205584 May 05 13:58:59.041617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 329/637] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:58:59.319292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:58:59.319895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:58:59.325749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:59.326246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:59.327010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:58:59.327450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:58:59.455038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:58:59.462591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ab83000f-b4bd-4f34-aeeb-c484beada6be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.147328 May 05 13:58:59.463159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 309/638] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:58:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:00.019516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:00.020127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:00.027124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.027576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.028348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.028785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.057919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:00.058632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:00.065243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.065698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.066515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.066954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.207519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:00.215870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-74ab0d0c-8af1-42e5-aebd-c186526e83d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.200177 May 05 13:59:00.216523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 330/639] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:00 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:00.248846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:00.257161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-52d35f6d-75ea-4a06-a8d7-2b3d428e3888 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.203153 May 05 13:59:00.257723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 310/640] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:00.479528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:00.480139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:00.486111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.486562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.487320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:00.487753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:00.614243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:00.622085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9ed59a28-7b08-4795-a45b-a538221178f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.146382 May 05 13:59:00.622656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 331/641] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:01.232538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:01.233153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:01.240368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.240824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.241598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.242051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.274217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:01.274881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:01.281410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.281859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.282689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.283123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.440085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:01.448246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5247fff1-2999-4ce5-aa54-2f19dcb28c94 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.219571 May 05 13:59:01.448900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 311/642] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:01 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:01.477913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:01.486213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8cb088aa-b8b9-4dfa-9eff-5429f1b0a77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.215754 May 05 13:59:01.487041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 332/643] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:01.639522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:01.640163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:01.646275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.646730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.647489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:01.647921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:01.775616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:01.782980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f928529b-3d39-4cde-8d23-a2462a13e03d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.147326 May 05 13:59:01.783559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 312/644] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:02.464319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:02.464959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:02.471382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.471829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.472590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.473081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.503501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:02.504257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:02.510903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.511362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.512133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.512575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.654898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:02.662260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-899cc235-7440-4882-8b73-c158c3ac1537 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.201882 May 05 13:59:02.678566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 333/645] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:02 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:02.693304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:02.700970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-230fc6f6-f4d8-427b-b508-22992ecb9908 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.201315 May 05 13:59:02.701524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 313/646] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:02.800261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:02.800912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:02.806723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.807166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.807927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:02.808362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:02.937857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:02.950195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6032e14b-b312-4a9b-ba86-71b3b17236ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.153485 May 05 13:59:02.950705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 334/647] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:03.061122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-646f410e-b893-49ff-b8e2-e78a693e79af req-9a7b31d4-3893-4f38-9828-6b0ded42ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a900c1d4-5ad8-4465-9f93-b1263bd89f66", "name": "network-vif-plugged", "status": "completed", "tag": "9552713a-7887-402b-80fe-83abd608be5c"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:03.069725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-646f410e-b893-49ff-b8e2-e78a693e79af req-9a7b31d4-3893-4f38-9828-6b0ded42ffee service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.070203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-646f410e-b893-49ff-b8e2-e78a693e79af req-9a7b31d4-3893-4f38-9828-6b0ded42ffee service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.082155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-646f410e-b893-49ff-b8e2-e78a693e79af req-9a7b31d4-3893-4f38-9828-6b0ded42ffee service nova] Creating event network-vif-plugged:9552713a-7887-402b-80fe-83abd608be5c for instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 on hv-cinder-73761 May 05 13:59:03.087707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-646f410e-b893-49ff-b8e2-e78a693e79af req-9a7b31d4-3893-4f38-9828-6b0ded42ffee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 May 05 13:59:03.088287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 314/648] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:03.685778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:03.686414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:03.692894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.693337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.694816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.695251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.719499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:03.720203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:03.726420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.726866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.727645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.728079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.872593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:03.880076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eddc01ba-4667-4110-8826-5d422b5b41fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.198303 May 05 13:59:03.880726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 335/649] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:03 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:03.909398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:03.917670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8342cb91-a0fe-4744-a01c-3b5d11abfbd8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1757 microversion: 2.1 time: 0.202807 May 05 13:59:03.918267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 315/650] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:03.967659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:03.968271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:03.974147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.974601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:03.975859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:03.976299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:04.106790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:04.113991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-316fa526-73b7-482d-b82b-ad50508b12b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.150074 May 05 13:59:04.114567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 336/651] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:04.897288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:04.897920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:04.904193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:04.904643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:04.905399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:04.905833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:04.934395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:04.935041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:04.941570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:04.942040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:04.942821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:04.943261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:05.083344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:05.091218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30c2abee-8060-4e2d-9cd0-8b1bfff48392 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.197734 May 05 13:59:05.091786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 316/652] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:04 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:05.122864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:05.130889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ae21af93-d513-436f-b5a4-0516b975fc8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1760 microversion: 2.1 time: 0.200282 May 05 13:59:05.131460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 337/653] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1760 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:05.132073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:05.133636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:05.139499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:05.139951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:05.140710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:05.141150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:05.268510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:05.275779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eae7138c-fa82-4d20-a6b1-99f463d2705a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1363 microversion: 2.1 time: 0.147689 May 05 13:59:05.276355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 317/654] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:06.108967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:06.109612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:06.116389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.116934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.117709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.118743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.244216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:06.251575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-29f96fd4-15a5-434b-8175-24dab9b1adc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.146500 May 05 13:59:06.252177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 338/655] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:06 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:06.292978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:06.293591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:06.299985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.300433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.301200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.301674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.430872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:06.438250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1d924a03-a63c-4c8a-a899-244b7e92b55e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1550 microversion: 2.1 time: 0.149529 May 05 13:59:06.438815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 318/656] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:06.454455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:06.454956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:06.460845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.461294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.462846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.463284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.541211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4daa3f76-dad6-43a6-931a-88c8ce240f3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090500 May 05 13:59:06.541808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 339/657] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 13:59:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:06.687101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb18a400-c87e-439f-a89b-f11e662555ab", "device": "/dev/sdb"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:06.688729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:06.694625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.695081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:06.695849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:06.696791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:07.269093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:07.269761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:07.276164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:07.276619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:07.278372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:07.278372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:07.437320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ce998ce4-44a5-4dc8-8302-82f8dac12591 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "POST /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753838 May 05 13:59:07.442660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 319/658] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:59:06 2022] POST /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:07.818433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:07.826729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d727dc67-f383-48e5-8add-a61b37e6290c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.562129 May 05 13:59:07.827412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 340/659] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:07 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:08.234763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-ea15fb42-2177-4e78-8a94-2f3c50111ca9 req-acf6b82b-1c03-48c1-8c5c-151a2d9de6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a900c1d4-5ad8-4465-9f93-b1263bd89f66", "tag": "9552713a-7887-402b-80fe-83abd608be5c"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:08.241610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-ea15fb42-2177-4e78-8a94-2f3c50111ca9 req-acf6b82b-1c03-48c1-8c5c-151a2d9de6d1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:08.242200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-ea15fb42-2177-4e78-8a94-2f3c50111ca9 req-acf6b82b-1c03-48c1-8c5c-151a2d9de6d1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:08.254665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-ea15fb42-2177-4e78-8a94-2f3c50111ca9 req-acf6b82b-1c03-48c1-8c5c-151a2d9de6d1 service nova] Creating event network-changed:9552713a-7887-402b-80fe-83abd608be5c for instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 on hv-cinder-73761 May 05 13:59:08.259650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-ea15fb42-2177-4e78-8a94-2f3c50111ca9 req-acf6b82b-1c03-48c1-8c5c-151a2d9de6d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031106 May 05 13:59:08.260314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 320/660] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:08.844241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:08.844893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:08.851315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:08.851771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:08.852551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:08.853171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:08.983105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:08.991880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-951daa49-9818-4ea3-af8f-986c0a58a0f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.151556 May 05 13:59:08.994045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 341/661] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:10.010328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:10.011039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:10.017069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:10.017521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:10.018424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:10.018864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:10.159573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:10.167186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-97a80e14-86ad-4cf7-a6bc-aa57f3680087 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.162232 May 05 13:59:10.167755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 321/662] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:11.184598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:11.185208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:11.192653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.193497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.194292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.194729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.327669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:11.335196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6b1ee5ac-6dde-48b4-b8f4-980e77077c0f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1508 microversion: 2.1 time: 0.155121 May 05 13:59:11.335763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 342/663] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:11.352481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:11.353086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:11.359680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.360070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.360834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.361272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.605170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a0bc3f94-e30b-4198-bf1f-d2c878d1bf14 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "POST /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34/action" status: 202 len: 0 microversion: 2.1 time: 0.256749 May 05 13:59:11.605781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 322/664] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:59:11 2022] POST /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:59:11.615515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:11.615515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:11.621396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.621988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.622827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:11.623264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:11.781097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:11.788901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d433acb9-81a1-4813-9510-d084ad530531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1516 microversion: 2.1 time: 0.178846 May 05 13:59:11.789473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 343/665] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:12.807487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:12.808114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:12.814763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:12.815206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:12.815977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:12.816403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:12.945359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:12.952853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7b55ca69-d97a-4d5a-883c-f77983910841 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.150308 May 05 13:59:12.953424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 323/666] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:13.036162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-43a04164-4f1d-4799-b9b5-985454fc5847 req-0bd68d78-1fd3-4667-beb6-f023fd8a3f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "name": "network-vif-unplugged", "status": "completed", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:13.041060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-43a04164-4f1d-4799-b9b5-985454fc5847 req-0bd68d78-1fd3-4667-beb6-f023fd8a3f80 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:13.041579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-43a04164-4f1d-4799-b9b5-985454fc5847 req-0bd68d78-1fd3-4667-beb6-f023fd8a3f80 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:13.052471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.compute.server_external_events [req-43a04164-4f1d-4799-b9b5-985454fc5847 req-0bd68d78-1fd3-4667-beb6-f023fd8a3f80 service nova] Unable to find a host for instance 3c3e07b2-6689-45b9-9da1-000c29490f34. Dropping event network-vif-unplugged {{(pid=123931) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 05 13:59:13.053332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-43a04164-4f1d-4799-b9b5-985454fc5847 req-0bd68d78-1fd3-4667-beb6-f023fd8a3f80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025213 May 05 13:59:13.053915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 344/667] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 05 13:59:13.970460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:13.971089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:13.977979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:13.978456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:13.979211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:13.979643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:14.105037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:14.112341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cfbc6f26-3ba8-41cc-a23f-1c02df9bdd28 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.145695 May 05 13:59:14.112906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 324/668] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:13 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:15.129619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:15.130271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:15.136605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:15.137048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:15.137812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:15.138273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:15.268421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:15.275907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6aa08b06-7ab0-4d5b-8719-84a6cf7aa8ec tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.150272 May 05 13:59:15.276465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 345/669] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:16.292544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:16.293124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:16.299468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:16.299924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:16.300693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:16.301134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:16.545433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:16.552856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f6f8ef99-0c50-48e9-a7aa-813d61076675 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.264195 May 05 13:59:16.553420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 325/670] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:16 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:17.570410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:17.571026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:17.577335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:17.577786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:17.578584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:17.579027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:17.755856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:17.763308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ae417ad8-5e3b-454a-b403-a4e1f588857c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.196781 May 05 13:59:17.763873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 346/671] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:17 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:18.780291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:18.780848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:18.787182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:18.787631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:18.788379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:18.788812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:18.915030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:18.922261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-33dba358-2d25-419e-a6eb-181910d8016c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.145948 May 05 13:59:18.922815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 326/672] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:19.939768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:19.940317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:19.946349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:19.947379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:19.948145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:19.948586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:20.075566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:20.082966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cbc3c37f-4838-40c5-995f-09b5f1843aa3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1518 microversion: 2.1 time: 0.147252 May 05 13:59:20.083531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 347/673] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:19 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:20.382875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dbdb1bf-63db-4ceb-9e3a-f59742f524bc"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:20.384048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:20.390624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:20.391076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:20.391847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:20.392314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:21.100303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:21.100916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:21.107248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:21.107698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:21.108466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:21.108906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:21.310800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a5ba7474-75d3-4017-ba25-ad2b484e13df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931904 May 05 13:59:21.311674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 327/674] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 13:59:20 2022] POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 194 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:21.315634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:21.325930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-078e904a-78dd-424e-8c4d-6c4ac444e38b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.229461 May 05 13:59:21.326547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 348/675] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:21 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:22.344461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:22.345206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:22.351856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:22.352317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:22.353710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:22.354185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:22.480435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:22.487696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a67b510-d204-45a2-9054-e6e52c1485f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.147443 May 05 13:59:22.488288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 328/676] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:22 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:23.503893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:23.504523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:23.510869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:23.511319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:23.512081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:23.512521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:23.643370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:23.651259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2de71fd3-6b32-464d-8686-c0c775656261 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.151158 May 05 13:59:23.651819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 349/677] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:23 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:24.668130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:24.668769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:24.675360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:24.675810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:24.676562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:24.676999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:24.807321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:24.815048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf9dabb4-262b-4bf2-84ec-0efead6886b4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.150836 May 05 13:59:24.815613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 329/678] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:25.832379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:25.833000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:25.839643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:25.840090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:25.840855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:25.841296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:25.971037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:25.978657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f02ab0ed-f548-4a59-a144-cab817f1bc84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.150196 May 05 13:59:25.979212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 350/679] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:26.995071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:26.995690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:27.001986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:27.002463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:27.003215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:27.003639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:27.130441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:27.138165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c5aa80e3-502a-4052-a472-fc7f37479cbf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.147174 May 05 13:59:27.138857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 330/680] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:26 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:28.155109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:28.155722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:28.162184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:28.162656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:28.163422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:28.163865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:28.295727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:28.304094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26406e6d-c5d0-4f03-bf1a-552d8b74b716 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.152851 May 05 13:59:28.304774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 351/681] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:28 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:29.322765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:29.323419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:29.329697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:29.330174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:29.330933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:29.331367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:29.455219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:29.463368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a6029046-3c19-4541-9f39-38c5c9d54dcc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.144405 May 05 13:59:29.463938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 331/682] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:29 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:30.480255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:30.480786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:30.487141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:30.487588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:30.488361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:30.488798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:30.616167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:30.624027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7ccd75a8-3109-4378-8fad-cad5a396d4aa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.147647 May 05 13:59:30.624594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 352/683] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:31.641082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:31.641646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:31.648220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:31.648754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:31.649685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:31.650722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:31.777589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:31.785129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-70e3fb7c-5b2b-4d6b-b883-c7a6200a1bbd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.147929 May 05 13:59:31.785939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 332/684] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:31 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:32.802074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:32.802608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:32.808988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:32.814322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:32.814322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:32.814322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:32.939022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:32.946887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cace6203-0b4b-4100-b050-186cc107a82a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.148156 May 05 13:59:32.947444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 353/685] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:32 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:33.012132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:33.013237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:33.019572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.020090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.020942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.021445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.046149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lazy-loading 'flavor' on Instance uuid 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:59:33.143832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:33.144411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:33.151137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.151592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.152367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.152808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.235085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid b6b7169b-ef8f-47d8-8aff-900814648280 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:59:33.368866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1542a03c-8a64-4744-aef7-4c49f906689f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action" status: 200 len: 32 microversion: 2.1 time: 0.360153 May 05 13:59:33.369517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 333/686] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:59:33 2022] POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 05 13:59:33.375755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-1945fc98-e9a8-4629-9287-dc3e6703c4dc req-a63dbe62-0427-4a9a-a19d-ccaa147b33e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "name": "network-vif-plugged", "status": "completed", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:33.384634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-1945fc98-e9a8-4629-9287-dc3e6703c4dc req-a63dbe62-0427-4a9a-a19d-ccaa147b33e9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.385078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-1945fc98-e9a8-4629-9287-dc3e6703c4dc req-a63dbe62-0427-4a9a-a19d-ccaa147b33e9 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.396106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-1945fc98-e9a8-4629-9287-dc3e6703c4dc req-a63dbe62-0427-4a9a-a19d-ccaa147b33e9 service nova] Creating event network-vif-plugged:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 13:59:33.400941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-1945fc98-e9a8-4629-9287-dc3e6703c4dc req-a63dbe62-0427-4a9a-a19d-ccaa147b33e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 May 05 13:59:33.401521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 334/687] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:33.406409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:33.407101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:33.413053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.413483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.414275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.414730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.432207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a811b389-f1ce-4c98-b0c7-028c0e5a20eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280/os-volume_attachments/bb18a400-c87e-439f-a89b-f11e662555ab" status: 202 len: 0 microversion: 2.1 time: 0.291500 May 05 13:59:33.433548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 354/688] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 13:59:33 2022] DELETE /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280/os-volume_attachments/bb18a400-c87e-439f-a89b-f11e662555ab => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 05 13:59:33.548719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:33.557577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-999544a4-ada2-4fbb-b2c5-958d19670e75 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154230 May 05 13:59:33.558180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 335/689] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:33.966619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:33.967246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:33.974869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.975460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:33.976386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:33.977048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:34.220403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:34.227927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-90b3b901-e62b-438c-aad3-1e04932a2d67 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.267604 May 05 13:59:34.229095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 355/690] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:33 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:34.575525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:34.576141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:34.582928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:34.583380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:34.584163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:34.584611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:34.848142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:34.855952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e00e297a-3e82-46f4-8433-7649f9f35e62 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.284805 May 05 13:59:34.861684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 336/691] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:35.244734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:35.246005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:35.252712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.253167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.253940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.254411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.450536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:35.458338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-68f3bdb6-077d-4285-9b2f-42d7b39753c6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1574 microversion: 2.1 time: 0.217391 May 05 13:59:35.458926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 356/692] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:35 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:35.599719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:35.607766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:35.607766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.607766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.608453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.608888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.633003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 13:59:35.873129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:35.873742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:35.879767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.880213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.881004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.881435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.911673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b5e9661-01a3-411f-8dea-e53cb8c019f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 204 len: 0 microversion: 2.1 time: 0.315366 May 05 13:59:35.912434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 337/693] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 13:59:35 2022] DELETE /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 13:59:35.920842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:35.921541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:35.928829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.928829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:35.928829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:35.929133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:36.057049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:36.065494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e4d7209c-2aa6-4a6e-b5da-4fdf91a91e10 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.195826 May 05 13:59:36.066513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 357/694] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:36.086466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:36.095037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7fc69203-8300-4719-ad85-6dc546e1d643 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1515 microversion: 2.1 time: 0.178140 May 05 13:59:36.095905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 338/695] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:35 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:36.475938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:36.476556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:36.483076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:36.483521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:36.484284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:36.484724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:36.609832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:36.617334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b534efb0-bb6c-4c37-8ae3-f6b25cefacfe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1561 microversion: 2.1 time: 0.145243 May 05 13:59:36.617891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 358/696] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:36 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:37.083008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:37.083665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:37.090831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:37.091285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:37.092097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:37.092538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:37.112188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:37.112894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:37.118808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:37.119262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:37.120030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:37.120482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:37.285737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:37.292779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:37.294861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d0cd2288-220e-44ea-b00b-5a314e272f33 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.215648 May 05 13:59:37.295447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 339/697] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:37.300064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-426d8d48-2ef0-400e-9168-9007a246d959 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1515 microversion: 2.1 time: 0.191684 May 05 13:59:37.300699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 359/698] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:37 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:38.312557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:38.313471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:38.316550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:38.317848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:38.323082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:38.324356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:38.329264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:38.329868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:38.329960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:38.330065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:38.330184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:38.330184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:38.589102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:38.596349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0125af5d-b95d-461b-af6e-f5d5b948f2cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1515 microversion: 2.1 time: 0.283725 May 05 13:59:38.596941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 360/699] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:38 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:38.605213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:38.614472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75b55f86-dfaf-45b7-a4de-44223e9fcdc7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.306454 May 05 13:59:38.615047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 340/700] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:39.035605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-d5e40204-b0a7-4a1a-9961-7e1e821f7f37 req-8882ed0a-5acd-4ee0-b9d9-7693646ac235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6b7169b-ef8f-47d8-8aff-900814648280", "name": "network-vif-deleted", "tag": "7d30db89-bf1d-41f5-b5c9-79958f87c913"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:39.043433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d5e40204-b0a7-4a1a-9961-7e1e821f7f37 req-8882ed0a-5acd-4ee0-b9d9-7693646ac235 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.044432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d5e40204-b0a7-4a1a-9961-7e1e821f7f37 req-8882ed0a-5acd-4ee0-b9d9-7693646ac235 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.055098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-d5e40204-b0a7-4a1a-9961-7e1e821f7f37 req-8882ed0a-5acd-4ee0-b9d9-7693646ac235 service nova] Creating event network-vif-deleted:7d30db89-bf1d-41f5-b5c9-79958f87c913 for instance b6b7169b-ef8f-47d8-8aff-900814648280 on hv-cinder-73761 May 05 13:59:39.060289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-d5e40204-b0a7-4a1a-9961-7e1e821f7f37 req-8882ed0a-5acd-4ee0-b9d9-7693646ac235 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083966 May 05 13:59:39.060870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 361/701] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 13:59:39.613304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:39.613925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:39.620282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.620738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.621506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.622596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.633901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:39.636521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:39.645367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.645824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.646642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.648703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.656093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:39.656540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:39.656991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'fault' on Instance uuid b6b7169b-ef8f-47d8-8aff-900814648280 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:59:39.714471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:39.721793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2d4acc51-3f60-4fc3-98ba-ff1710d4f3dc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 200 len: 1309 microversion: 2.1 time: 0.112321 May 05 13:59:39.722600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 341/702] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:39 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:39.804610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:39.810093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c5b609f5-1f3a-4ecf-b727-b49efe7524ce tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.181333 May 05 13:59:39.810660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 362/703] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:40.739865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:40.740486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: b6b7169b-ef8f-47d8-8aff-900814648280] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:40.747331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:40.747799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:40.748566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:40.749006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:40.761957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] HTTP exception thrown: Instance b6b7169b-ef8f-47d8-8aff-900814648280 could not be found. May 05 13:59:40.763194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Returning 404 to user: Instance b6b7169b-ef8f-47d8-8aff-900814648280 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:59:40.764015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24a69bd7-a158-4423-b84a-76acd535f9eb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280" status: 404 len: 111 microversion: 2.1 time: 0.028094 May 05 13:59:40.764535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 342/704] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:40 2022] GET /compute/v2.1/servers/b6b7169b-ef8f-47d8-8aff-900814648280 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 13:59:40.827679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:40.828299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:40.834559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:40.835016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:40.835793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:40.836237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:40.963186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:40.972824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-44ead543-d259-4462-bdc6-7a869d856cd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149491 May 05 13:59:40.973390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 363/705] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:41.990749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:41.991291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:41.999095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:41.999545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:42.000308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:42.000742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:42.137763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:42.145746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f714dae2-f145-49c3-9dad-ed907ccdfc36 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.158954 May 05 13:59:42.146343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 343/706] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:43.162758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:43.163368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:43.170298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:43.170745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:43.171501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:43.174476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:43.295848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:43.303598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a425781-680f-4c49-908a-8f40208ebcf6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144627 May 05 13:59:43.304167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 364/707] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:44.320645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:44.321264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:44.327603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:44.328053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:44.328814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:44.329252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:44.455264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:44.463209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1bd4853f-a00d-4155-bd77-ab04f8001474 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146577 May 05 13:59:44.464036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 344/708] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:45.480552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:45.481170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:45.487435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:45.487884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:45.488681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:45.489122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:45.616594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:45.624977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-762dba9e-9dff-4112-9a12-4602a477fa47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148271 May 05 13:59:45.625532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 365/709] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:46.597265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:46.597969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:46.604232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:46.604763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:46.605638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:46.606156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:46.629604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-97d525eb-180b-4ec2-b729-de9cb46f2728 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/ips" status: 200 len: 151 microversion: 2.20 time: 0.137346 May 05 13:59:46.630193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 345/710] 10.222.0.26 () {60 vars in 1288 bytes} [Thu May 5 13:59:46 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 13:59:46.642116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:46.642735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:46.648831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:46.649289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:46.650092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:46.650542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:46.780286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:46.788070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a154261c-b54d-4bec-9afc-435271b9a93c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149800 May 05 13:59:46.788948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 366/711] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:47.805047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:47.805703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:47.812762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:47.813215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:47.813982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:47.814448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:47.941819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:47.949515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6299b4b8-468b-4d95-a81c-738b7d00e043 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148329 May 05 13:59:47.950088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 346/712] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:48.966620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:48.967228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:48.973587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:48.974134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:48.974898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:48.975335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:49.100727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:49.109112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ab5f91d3-21f6-41ee-be8f-785a56a4dc6b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146597 May 05 13:59:49.109677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 367/713] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:50.125877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:50.130215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:50.132917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:50.133373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:50.134171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:50.134618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:50.265511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:50.273621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f22c0d81-d0b1-4cd8-9629-0689538cd372 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151582 May 05 13:59:50.274210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 347/714] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:51.126517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1997814840", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "networks": [{"uuid": "5159c019-65a1-4795-a9bf-2254a47f332a"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:51.174826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] validate_networks() for [('5159c019-65a1-4795-a9bf-2254a47f332a', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 13:59:51.292758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:51.293242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:51.299701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:51.300354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:51.301126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:51.301564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:51.493182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:51.501784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aa538fb2-908f-4142-915a-a4c40c0152e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.213204 May 05 13:59:51.502388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 348/715] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:51.601068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 13:59:51.601493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 13:59:51.601966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 13:59:51.602402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 13:59:51.602848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 13:59:51.612529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:51.612977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:51.613775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:51.614242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:51.630229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Getting quotas for project fc26737fc8c745fa952abfd840bf9278. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 13:59:51.634112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Getting quotas for user baf7c7226e1747f397783c8d4429f601 and project fc26737fc8c745fa952abfd840bf9278. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 13:59:51.644896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 13:59:51.647142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 13:59:51.844907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5f7332f0-5d54-4c4a-bc25-ab4f6472a274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722827 May 05 13:59:51.845548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 368/716] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 13:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 13:59:51.855580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-292e8837-9668-4115-86a5-102d1b268d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:51.856124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-292e8837-9668-4115-86a5-102d1b268d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:51.908389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-292e8837-9668-4115-86a5-102d1b268d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:51.914807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-292e8837-9668-4115-86a5-102d1b268d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1219 microversion: 2.1 time: 0.063242 May 05 13:59:51.915366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 349/717] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:52.100886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:52.101500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:52.107428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.107820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.108602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.109086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.133328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lazy-loading 'flavor' on Instance uuid 93818186-77bc-406b-8664-b67f320534c5 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 13:59:52.519541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:52.520273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:52.527471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.528111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.529008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.529512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.659994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:52.668142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db68a8b8-28bb-4f20-8b3d-409ef19de2ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153241 May 05 13:59:52.668695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 350/718] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:52.677886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-191e0ab6-1023-4d51-981f-5eae37b6e5df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/action" status: 202 len: 0 microversion: 2.20 time: 0.581171 May 05 13:59:52.678605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 369/719] 10.222.0.26 () {62 vars in 1318 bytes} [Thu May 5 13:59:52 2022] POST /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 05 13:59:52.686535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:52.687245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:52.693937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.694448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.695202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.695642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.822346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:52.830816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:52.832412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:52.833602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-192294ef-0cf1-4efb-9bad-ffa1812e48e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.150859 May 05 13:59:52.834186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 351/720] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:52 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:59:52.933263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:52.933972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:52.940972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.941366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:52.942175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:52.942622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:53.004506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:53.012014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-15ee62d2-2325-4a46-915f-a4816c67f3ed tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1223 microversion: 2.1 time: 0.083132 May 05 13:59:53.012573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 370/721] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:53.684587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:53.685206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:53.691650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:53.692110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:53.692879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:53.693327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:53.822097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:53.830598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3589173c-3050-4dfa-9755-7a697bc6e483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149823 May 05 13:59:53.831174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 352/722] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:53.851762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:53.852384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:53.858721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:53.859177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:53.859944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:53.860388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:53.991121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:53.998837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:54.000836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:54.001984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c1348425-00eb-4331-82a8-e5eeec475eef tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.154103 May 05 13:59:54.002568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 371/723] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:53 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:59:54.028677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:54.029285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:54.035219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:54.035667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:54.036421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:54.036853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:54.099465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:54.107053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b93b9dd9-3ef1-4f0a-8f16-8ae9264d5b4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1271 microversion: 2.1 time: 0.082344 May 05 13:59:54.107615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 353/724] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:54.848344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:54.848996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:54.856685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:54.857284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:54.860674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:54.860674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:55.021096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:55.022035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:55.029833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:55.034568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:55.034568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:55.034568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:55.064920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:55.072948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da3a4eba-ced9-4f68-bbcb-d6b26a58e25a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.229072 May 05 13:59:55.073531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 372/725] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:55.123541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:55.124164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:55.129964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:55.130445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:55.131211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:55.131651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:55.227329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:55.234609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7eb12430-5c99-4648-ade9-1369e80ad2b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1279 microversion: 2.1 time: 0.114943 May 05 13:59:55.235171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 373/726] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:55.255132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:55.262722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:55.264189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:55.265330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31baefe7-a7ae-4ce8-a973-fefd8b421351 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.248785 May 05 13:59:55.265877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 354/727] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:55 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:59:56.090946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:56.095340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:56.099023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.099605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.100484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.101022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.251521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:56.252146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:56.258554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.259008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.259785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.260229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.359372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:56.367636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5700ddb6-f040-4b06-87fc-94d1b8a838c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.280805 May 05 13:59:56.368208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 374/728] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:56.372736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:56.373332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:56.379198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.379647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.380414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:56.380971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:56.514149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:56.521913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-90862538-0898-4d14-9cb9-ce45b89d51fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.274207 May 05 13:59:56.531343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 355/729] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:56.826474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:56.835142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:56.836621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:56.837775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6eb733f3-ec88-4e14-b91c-124889a1ffbb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.468670 May 05 13:59:56.838368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 375/730] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:56 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:59:57.186870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-82af3e83-eea3-4390-a9ca-0856cecc679c req-6f395565-7fdd-4347-b91f-2a7bbbb2f026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d5d14e-9371-4d0f-8b25-22c081bab3d9", "tag": "59f851bd-09ad-417f-a01c-9de52a95c857"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:57.196080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-82af3e83-eea3-4390-a9ca-0856cecc679c req-6f395565-7fdd-4347-b91f-2a7bbbb2f026 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.197095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-82af3e83-eea3-4390-a9ca-0856cecc679c req-6f395565-7fdd-4347-b91f-2a7bbbb2f026 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.208584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-82af3e83-eea3-4390-a9ca-0856cecc679c req-6f395565-7fdd-4347-b91f-2a7bbbb2f026 service nova] Creating event network-changed:59f851bd-09ad-417f-a01c-9de52a95c857 for instance e2d5d14e-9371-4d0f-8b25-22c081bab3d9 on hv-cinder-73761 May 05 13:59:57.213399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-82af3e83-eea3-4390-a9ca-0856cecc679c req-6f395565-7fdd-4347-b91f-2a7bbbb2f026 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033414 May 05 13:59:57.214334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 356/731] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 13:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 13:59:57.385032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:57.385582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:57.391839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.392297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.393074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.393519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.540020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:57.540753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:57.546900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.547349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.548724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.549157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.602817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:57.611685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e85dc062-123b-4a98-8960-863dc1cab733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1713 microversion: 2.1 time: 0.230792 May 05 13:59:57.612259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 376/732] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1713 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:57.720078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:57.720587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:57.726762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.727217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.728062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.728493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.786366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:57.795929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3642d720-8c13-4b1f-9236-dd013fbd4d04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.260577 May 05 13:59:57.797334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 357/733] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:57 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:57.823365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] HTTP exception thrown: Cannot 'detach_volume' instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a while it is in vm_state rescued May 05 13:59:57.823969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Returning 409 to user: Cannot 'detach_volume' instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a while it is in vm_state rescued {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 13:59:57.824804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-55e8613f-2918-4ad4-a9e3-0eb77fe14dc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments/8dbdb1bf-63db-4ceb-9e3a-f59742f524bc" status: 409 len: 152 microversion: 2.1 time: 0.109382 May 05 13:59:57.825349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 377/734] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 13:59:57 2022] DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments/8dbdb1bf-63db-4ceb-9e3a-f59742f524bc => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 05 13:59:57.833651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 13:59:57.834222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:57.840367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.840868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.841599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.842050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.856251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:57.856871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:57.865068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.865520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:57.866504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:57.867307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:58.052794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-06bc7910-016f-49d2-ae01-19e4376c671f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action" status: 202 len: 0 microversion: 2.1 time: 0.222770 May 05 13:59:58.053597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 358/735] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 13:59:57 2022] POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 13:59:58.064649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:58.065744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:58.074978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:58.075170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:58.075762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:58.077119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:58.077886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:58.083966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:58.085756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:58.087101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-10bc0ef8-d0b3-4883-98e9-ebdc9f1b19b5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.235324 May 05 13:59:58.087954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 378/736] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:57 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 13:59:58.242419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:58.250724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d037ecf3-8ce4-4cc2-b9c5-6bc2cfaf624d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1721 microversion: 2.1 time: 0.192697 May 05 13:59:58.251357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 359/737] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 13:59:58.814881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:58.815414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:58.821916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:58.822394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:58.823161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:58.823600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:58.951425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:58.958604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf6438e0-ab3e-4fe5-86a9-1ca231f3ab6e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.148229 May 05 13:59:58.959172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 379/738] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:59.107472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:59.107841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:59.114934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.115380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:59.116162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.116602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:59.242940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:59.251288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:59.252780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:59.253931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4834ff29-6acb-47ae-9e88-c52b1fc7c54a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.151040 May 05 13:59:59.254528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 360/739] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 13:59:59 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 13:59:59.267995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:59.268611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:59.274619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.275080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:59.275845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.276288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:59.430303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 13:59:59.438174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-51323d0c-7802-4b35-9494-43a30486205c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1721 microversion: 2.1 time: 0.173907 May 05 13:59:59.440598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 380/740] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 13:59:59.975659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 13:59:59.976190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 13:59:59.982042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.982512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 13:59:59.983276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 13:59:59.983826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:00.113931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:00.121214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-33a209dc-d9b3-465c-bcd7-ecc52f51da06 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.149600 May 05 14:00:00.121771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 361/741] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 13:59:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:00.271965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:00.272533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:00.278881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:00.279332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:00.280096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:00.280535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:00.404660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:00.412283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:00.413806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:00.414974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eafb94e5-fd0b-4c0c-af0e-410ae613c5f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.147040 May 05 14:00:00.415531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 381/742] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:00 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:00.460390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:00.461297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:00.467818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:00.468269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:00.469037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:00.469470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:00.596790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:00.604537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7b5a9150-b015-4d55-aa7b-4be858b4c313 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1721 microversion: 2.1 time: 0.149263 May 05 14:00:00.605091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 362/743] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:01.137913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:01.156418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:01.156418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.156418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.156418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.156911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.276085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:01.283866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f19170f5-3a17-43d1-9f95-e163317b9c3d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.149821 May 05 14:00:01.284432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 382/744] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:01.436554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:01.436554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:01.440415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.440869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.441634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.442125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.448067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-0c391bfa-ecc8-4932-bfa5-c20c5de01a06 req-f7cc7c15-c155-4f97-b986-278a2be3587c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d5d14e-9371-4d0f-8b25-22c081bab3d9", "name": "network-vif-plugged", "status": "completed", "tag": "59f851bd-09ad-417f-a01c-9de52a95c857"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:01.456665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-0c391bfa-ecc8-4932-bfa5-c20c5de01a06 req-f7cc7c15-c155-4f97-b986-278a2be3587c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.457113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-0c391bfa-ecc8-4932-bfa5-c20c5de01a06 req-f7cc7c15-c155-4f97-b986-278a2be3587c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.468567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-0c391bfa-ecc8-4932-bfa5-c20c5de01a06 req-f7cc7c15-c155-4f97-b986-278a2be3587c service nova] Creating event network-vif-plugged:59f851bd-09ad-417f-a01c-9de52a95c857 for instance e2d5d14e-9371-4d0f-8b25-22c081bab3d9 on hv-cinder-73761 May 05 14:00:01.473740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-0c391bfa-ecc8-4932-bfa5-c20c5de01a06 req-f7cc7c15-c155-4f97-b986-278a2be3587c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085900 May 05 14:00:01.474441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 363/745] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:01.588665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:01.597041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:01.598565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:01.599731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-28fc4fc2-2599-453c-9aef-6b87b4c642c5 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.170340 May 05 14:00:01.600297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 383/746] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:01 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:01.622486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:01.623150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:01.630258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.630725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.631488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:01.631928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:01.764825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:01.772802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4c062ab6-710a-4426-9189-cb1ae1b1f1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1721 microversion: 2.1 time: 0.154625 May 05 14:00:01.773364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 364/747] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:02.301118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:02.301765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:02.308356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.308813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.309595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.310053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.472477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:02.479964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dad1dd9f-5ca4-4f85-be19-d51619bc18b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.183713 May 05 14:00:02.486170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 384/748] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:02.617743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:02.618380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:02.624769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.625224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.625988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.626452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.753559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:02.761618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:02.763156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:02.764399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e1a4e44-6823-467c-aa79-3ab5a7df745a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.150577 May 05 14:00:02.765012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 365/749] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:02 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:02.790233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:02.790849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:02.796818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.797370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.798168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.799252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.928240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:02.936023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5499198e-22d7-4de9-adff-b14f6555bf45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1727 microversion: 2.1 time: 0.149788 May 05 14:00:02.936573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 385/750] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:02.952544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:02.952980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:02.959449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.959905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:02.960673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:02.961117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.036455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7cc8f579-3a79-454b-8b33-b3e1af665028 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087703 May 05 14:00:03.037064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 366/751] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 14:00:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:03.496621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:03.497319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:03.504803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.505261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.506065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.506511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.673449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:03.681443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-74ed521f-e910-44a9-9293-8270f81b9e37 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1319 microversion: 2.1 time: 0.188653 May 05 14:00:03.682004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 386/752] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:03.761607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:03.762137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:03.767984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.768421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.769183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.769621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.784485 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:03.785118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:03.791206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.791664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.792453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:03.792912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:03.794261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cca0a060-49f3-4422-94b8-4642d0d52634 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/ips" status: 200 len: 147 microversion: 2.1 time: 0.088988 May 05 14:00:03.795954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 367/753] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 14:00:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/ips => generated 147 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:04.194575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:04.202348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:04.203826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:04.205490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-72029faf-5353-46d1-a9b6-c9f235740908 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.425039 May 05 14:00:04.206310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 387/754] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:03 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:04.388547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-f9aecfe0-88ab-4313-a325-514b95db15ec req-77ec13ae-ad66-4bb4-ae87-79a7f78d05a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:04.397255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f9aecfe0-88ab-4313-a325-514b95db15ec req-77ec13ae-ad66-4bb4-ae87-79a7f78d05a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:04.397607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f9aecfe0-88ab-4313-a325-514b95db15ec req-77ec13ae-ad66-4bb4-ae87-79a7f78d05a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:04.410749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-f9aecfe0-88ab-4313-a325-514b95db15ec req-77ec13ae-ad66-4bb4-ae87-79a7f78d05a7 service nova] Creating event network-changed:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 14:00:04.416370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-f9aecfe0-88ab-4313-a325-514b95db15ec req-77ec13ae-ad66-4bb4-ae87-79a7f78d05a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031237 May 05 14:00:04.416977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 368/755] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:04.699020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:04.699649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:04.707540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:04.708958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:04.713044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:04.713044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:04.911914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:04.920647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8c1171ab-89b6-4acb-a368-8a14240190e3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1509 microversion: 2.1 time: 0.225931 May 05 14:00:04.921309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 388/756] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:00:04 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:00:04.937896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41d32857-c7c5-4ec2-907f-cb49c41e09eb", "device": "/dev/sdb"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:04.939902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:04.946507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:04.951096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:04.951096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:04.951096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.203185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-305997473"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:05.203835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:05.212033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.212483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.213265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.213733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.347936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.network.security_group_api [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Removing security group 36763584-850c-4245-b091-dbdb309dd793 from port b70d099e-c754-4a00-8570-a5978889ba6b May 05 14:00:05.647999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a559b837-a61e-4958-bc31-bc5d863f5394 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "POST /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714215 May 05 14:00:05.648928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 369/757] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 14:00:04 2022] POST /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:05.654716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:05.655467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:05.666989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.666989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.666989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.666989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.790842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f6ca16f5-f8e6-4ab3-bf8b-a3d58742b6f4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action" status: 202 len: 0 microversion: 2.1 time: 0.591811 May 05 14:00:05.791970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 389/758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 14:00:05 2022] POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 05 14:00:05.799665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88d55e17-b491-455d-961b-13e85bb1779f"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:05.800810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:05.809990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.810474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.811279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:05.811743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:05.898860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:05.919654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:05.921775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:05.927180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0baacfb3-ce26-4fd4-9569-fe5a47cea11b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.276347 May 05 14:00:05.942059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 370/759] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:05 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:06.433548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "tag": "33675a7a-a600-4850-b232-cee945437d20"}, {"name": "network-changed", "server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:06.443450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:06.443900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:06.456392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] Creating event network-changed:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 14:00:06.456903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] Creating event network-changed:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 14:00:06.463350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-7c0d1d8a-b11d-4b3c-822f-83ab12bd6514 req-95470ad3-5859-43da-bd79-c41c0acd3161 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033530 May 05 14:00:06.464230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 371/760] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:06.493679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e7998ac3-19f4-482b-801c-b33bff6e256e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700240 May 05 14:00:06.494358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 390/761] 10.222.0.26 () {60 vars in 1322 bytes} [Thu May 5 14:00:05 2022] POST /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:06.949418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:06.950187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:06.956658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:06.957141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:06.962348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:06.962348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:07.231764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:07.240328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:07.241823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:07.243081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a505e3f1-3061-420e-9e02-70d797ce33bf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.298123 May 05 14:00:07.243639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 372/762] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:06 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:07.671497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:07.672243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:07.678533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:07.679097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:07.680190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:07.680780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:07.772784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:00:07.979667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1fdb8cf2-c78d-4ce0-88bf-187d65cd1c22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 202 len: 0 microversion: 2.1 time: 0.313120 May 05 14:00:07.980265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 391/763] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:00:07 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:00:07.989162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:07.990200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:07.996498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:07.996947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:07.997754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:07.998166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:08.030417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76019b8a-047c-43ca-aef7-ed359e5881ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 May 05 14:00:08.031308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 373/764] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:08.265934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:08.266793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:08.273770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:08.274254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:08.275248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:08.275960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:08.482454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-3d5c9d0d-95da-4d71-b50b-1a59ad2d1e1e req-fbc369e2-c763-4a99-ac0d-fe0d94c4e96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:08.484543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:08.491520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-3d5c9d0d-95da-4d71-b50b-1a59ad2d1e1e req-fbc369e2-c763-4a99-ac0d-fe0d94c4e96c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:08.492041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-3d5c9d0d-95da-4d71-b50b-1a59ad2d1e1e req-fbc369e2-c763-4a99-ac0d-fe0d94c4e96c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:08.493254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:08.494795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:08.495955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c4273af4-08af-4862-b568-43ad084c3b01 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1722 microversion: 2.20 time: 0.234875 May 05 14:00:08.496521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 392/765] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:08 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:08.504459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-3d5c9d0d-95da-4d71-b50b-1a59ad2d1e1e req-fbc369e2-c763-4a99-ac0d-fe0d94c4e96c service nova] Creating event network-changed:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 14:00:08.510064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-3d5c9d0d-95da-4d71-b50b-1a59ad2d1e1e req-fbc369e2-c763-4a99-ac0d-fe0d94c4e96c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031312 May 05 14:00:08.512452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 374/766] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:09.042577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:09.043825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:09.050248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:09.050707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:09.051477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:09.051932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:09.079387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9e40281b-6ed4-4c05-b918-bf8050ce3640 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040801 May 05 14:00:09.079944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 393/767] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:09.515107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:09.515799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:09.522355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:09.522800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:09.523560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:09.523993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:09.660698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:09.675500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:09.675500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:09.675500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba7a82aa-222b-4d34-8c42-42ae368bc107 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1743 microversion: 2.20 time: 0.160765 May 05 14:00:09.675757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 375/768] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:09 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:10.091191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:10.092114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:10.099377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:10.099844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:10.100623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:10.101074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:10.129091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8fef2204-9684-4b2b-82c6-49d43dd7c4a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042030 May 05 14:00:10.129589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 394/769] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:10.690140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:10.690746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:10.697106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:10.697561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:10.699215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:10.699680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:10.846575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:10.854606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:10.856100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:10.857468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf71a21f-3d7b-42de-9f9f-51483d91204f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.171343 May 05 14:00:10.858094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 376/770] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:10 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:11.142467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:11.145138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:11.153878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:11.154362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:11.155178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:11.155810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:11.186889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fbc84498-9aa9-4ebf-9493-9856252e2163 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049400 May 05 14:00:11.187719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 395/771] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:11.345252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-38a9b674-20ab-40f6-b0ed-f37304b026ea req-4db7c73f-5482-47b4-838a-fde2e0da1c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "name": "network-vif-plugged", "status": "completed", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:00:11.359489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-38a9b674-20ab-40f6-b0ed-f37304b026ea req-4db7c73f-5482-47b4-838a-fde2e0da1c5f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:11.360000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-38a9b674-20ab-40f6-b0ed-f37304b026ea req-4db7c73f-5482-47b4-838a-fde2e0da1c5f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:11.375591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-38a9b674-20ab-40f6-b0ed-f37304b026ea req-4db7c73f-5482-47b4-838a-fde2e0da1c5f service nova] Creating event network-vif-plugged:eda82bc2-7da3-440e-8aee-53635c08bbe1 for instance 93818186-77bc-406b-8664-b67f320534c5 on hv-cinder-73761 May 05 14:00:11.381798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-38a9b674-20ab-40f6-b0ed-f37304b026ea req-4db7c73f-5482-47b4-838a-fde2e0da1c5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040050 May 05 14:00:11.383007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 377/772] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:11.877293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:11.877831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:11.891425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:11.892216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:11.893062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:11.893646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:12.044010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:12.053343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:12.055076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:12.056420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-74cef289-9267-403f-a202-1028b4accada tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.183199 May 05 14:00:12.057135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 396/773] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:11 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:12.200118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:12.201340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:12.208353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:12.208874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:12.210109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:12.210416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:12.256827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9fd40b42-1425-4b4e-886d-65e1f9c2527b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061412 May 05 14:00:12.266591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 378/774] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:13.075178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:13.076515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:13.087754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:13.088546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:13.089843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:13.090536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:13.273330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:13.274310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:13.286860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:13.287538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:13.288549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:13.289182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:13.291037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:13.302939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:13.304427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:13.305592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aabf8a51-da41-42aa-b86d-3cc80caad51e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.234461 May 05 14:00:13.306361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 397/775] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:13 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:13.340678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6390c8ba-872a-4e7a-99ca-f38f06f16dbf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071243 May 05 14:00:13.341617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 379/776] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:14.325843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:14.327609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:14.334224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:14.334679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:14.335456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:14.335899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:14.352254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:14.353230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:14.359485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:14.359931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:14.360693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:14.361801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:14.390208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d422668-c0b9-4ddd-ab65-29efc3d76dea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041839 May 05 14:00:14.393847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 380/777] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:14.469056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:14.477905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:14.479730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:14.480331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-48f7745b-8a8b-4635-9dba-ec282eae1b23 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.158409 May 05 14:00:14.480898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 398/778] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:14 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:15.403793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:15.405381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:15.415570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:15.416020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:15.416800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:15.417295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:15.452854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ce001c3-234b-4c42-8098-c11b6e556349 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053039 May 05 14:00:15.454064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 381/779] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:15.498842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:15.499453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:15.508550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:15.509004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:15.509789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:15.510262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:15.663148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:15.673086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:15.674770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:15.679904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf4bdb9e-772d-46bf-b53c-4c9e57d780f2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.180968 May 05 14:00:15.679904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 399/780] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:15 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:16.465170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:16.466800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:16.473751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:16.474168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:16.475170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:16.475846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:16.509922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8bfaead0-b703-493f-a692-3015235a0184 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049057 May 05 14:00:16.510534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 382/781] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:16.696777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:16.697802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:16.705928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:16.709740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:16.709740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:16.709740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:16.870512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:16.884427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:16.884691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:16.885864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a966ae84-0029-4cd0-a162-1fffa88e5621 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.193111 May 05 14:00:16.886721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 400/782] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:16 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:17.522389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:17.523270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:17.531885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:17.533409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:17.533656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:17.534125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:17.571081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c63a4310-8635-4a84-9d0c-74ab0b5fb1ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052700 May 05 14:00:17.572153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 383/783] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:17.908283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:17.909149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:17.915785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:17.916236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:17.917049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:17.917492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:18.064954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:18.075226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:18.076732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:18.077914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-23ed1ccd-4583-4430-b5c2-ae4484665280 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.177030 May 05 14:00:18.078531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 401/784] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:17 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:18.583289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:18.585698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:18.592348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:18.592800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:18.593773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:18.594569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:18.626561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dac0d15d-aa2d-4da9-8222-3eb8ce7e69bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047358 May 05 14:00:18.631199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 384/785] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:19.100815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:19.104510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:19.114110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:19.115361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:19.116158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:19.117213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:19.326745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:19.341399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:19.343238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:19.344107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0344dd2d-f0f5-4e90-b2ba-6661449b4834 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.250913 May 05 14:00:19.344673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 402/786] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:19 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:19.637952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:19.638913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:19.646460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:19.646926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:19.647716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:19.648158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:19.680825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dde3ac13-12a1-42a4-bf3f-a53c534d349c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 May 05 14:00:19.686641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 385/787] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:20.363337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:20.363879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:20.370567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:20.371030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:20.371808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:20.372261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:20.497038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:20.504719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:20.506244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:20.507439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dc3aa6da-7431-4b19-92f1-d09588c55e96 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.148588 May 05 14:00:20.508005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 403/788] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:20 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:20.694713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:20.695678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:20.702662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:20.707218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:20.707218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:20.707218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:20.742315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65d63d90-997c-4ecc-8a17-1c179abc71d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054430 May 05 14:00:20.746141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 386/789] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:21.526038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:21.526678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:21.532975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:21.533426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:21.534220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:21.534660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:21.672514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:21.680252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:21.681744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:21.682930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a7b5cdc9-e84d-44f9-9e4b-4882af281586 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.160783 May 05 14:00:21.683492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 404/790] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:21 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:21.753868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:21.754883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:21.761209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:21.761663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:21.762562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:21.763004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:21.791330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6d30b064-e517-4f5d-8f93-a7bf7537abec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042167 May 05 14:00:21.791880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 387/791] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:22.701422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:22.701984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:22.708869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:22.709318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:22.710109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:22.710554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:22.803157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:22.804104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:22.811189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:22.811359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:22.815129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:22.815129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:22.842910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:22.843389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f65ade86-2da6-4871-871b-016f312ab2ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 May 05 14:00:22.843971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 388/792] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:22.850823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:22.852309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:22.853515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-475d0073-5c27-4af0-92fe-7c358ce41cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.155979 May 05 14:00:22.854097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 405/793] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:22 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:23.853988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:23.854943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:23.861263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:23.861742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:23.862530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:23.862975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:23.872361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:23.872999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:23.879777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:23.880225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:23.880986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:23.881422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:23.891687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46fd4b63-a35e-400e-9923-babe21a77893 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041607 May 05 14:00:23.892243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 389/794] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:24.005961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:24.013796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:24.015318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:24.016494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-adecadda-480b-4514-94e7-b01db1c931ed tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.147927 May 05 14:00:24.017049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 406/795] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:23 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:24.903255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:24.904173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:24.911094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:24.911568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:24.912328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:24.912761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:24.940919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fe9fe327-a7be-440d-bb8e-f1e06ee377f2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 May 05 14:00:24.941465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 390/796] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:25.035014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:25.035621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:25.041904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:25.042377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:25.043136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:25.043570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:25.173377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:25.181582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:25.183089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:25.184238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-676d76ec-ea81-41f2-af8d-afc77e8f18ce tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.153126 May 05 14:00:25.184899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 407/797] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:25 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:25.952805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:25.953727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:25.960598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:25.961046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:25.961803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:25.962279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:25.991685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ab7d1410-a5c2-4060-bb5c-76d259267477 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042734 May 05 14:00:25.992252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 391/798] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:26.203083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:26.203649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:26.210567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:26.211024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:26.211787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:26.212236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:26.348333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:26.356056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:26.358432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:26.360377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c408ce96-f1db-4ded-8526-73acd0ba61a6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.161033 May 05 14:00:26.361799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 408/799] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:26 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:27.003575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:27.004512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:27.011372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:27.011830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:27.012650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:27.013099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:27.046086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dcca18bb-8b87-4718-85dc-7591adca72b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 May 05 14:00:27.046883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 392/800] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:27.380850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:27.381482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:27.387858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:27.388316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:27.389080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:27.389523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:27.520843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:27.528717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:27.530263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:27.531430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-29fc903e-48ba-4388-9a78-960b7845893b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.154706 May 05 14:00:27.532030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 409/801] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:27 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:28.059534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:28.060420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:28.066941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:28.067396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:28.068170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:28.068607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:28.097631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0f68cc5f-bf42-46de-b654-1414cbbc06bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042153 May 05 14:00:28.098552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 393/802] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:28.549241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:28.549922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:28.556533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:28.556985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:28.557755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:28.558236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:28.686739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:28.697678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:28.699219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:28.700392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3b8f41dc-918e-497d-9f76-b6b650ee4acf tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.155064 May 05 14:00:28.701127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 410/803] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:28 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:29.109717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:29.110678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:29.116984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:29.117435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:29.118227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:29.118668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:29.150002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83b5c8b1-6b2b-4de3-8855-681c8f274c0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 May 05 14:00:29.150624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 394/804] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:29.719323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:29.719949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:29.726335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:29.726788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:29.727564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:29.728013 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:29.858994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:29.867555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:29.869046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:29.870240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d1309c78-5f79-4e1b-9757-5d56fe2281eb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.154843 May 05 14:00:29.870793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 411/805] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:29 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:30.162949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:30.163894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:30.170538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:30.170982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:30.171747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:30.172229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:30.202853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76311fcf-5036-4eae-95fa-9929b154489d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 May 05 14:00:30.203397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 395/806] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:30.888964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:30.889664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:30.897460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:30.897938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:30.898727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:30.899162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:31.036543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:31.044300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:31.045777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:31.046988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aeb7a106-f92c-4595-a534-9d991ec78cd8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.162800 May 05 14:00:31.047539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 412/807] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:30 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:31.215268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:31.216663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:31.223855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:31.224307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:31.225088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:31.225560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:31.256844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ae4abcfe-0862-4ba6-a7e7-32b65f38fcab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 May 05 14:00:31.257436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 396/808] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:32.065898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:32.066555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:32.073044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:32.073502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:32.074309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:32.074755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:32.201064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:32.209855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:32.211352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:32.212512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e44a3d49-e826-43bb-83fb-be3f8654fb7a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.151030 May 05 14:00:32.213080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 413/809] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:32 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:32.268774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:32.269796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:32.276169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:32.276626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:32.277391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:32.277833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:32.305180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-efad0e63-fb40-47e3-af51-5fa6b331515f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040883 May 05 14:00:32.305730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 397/810] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:33.229865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:33.230432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:33.236760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:33.237212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:33.238036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:33.238483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:33.316775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:33.317744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:33.324365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:33.324820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:33.325604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:33.326070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:33.357194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-07e71d4a-cb5d-457f-8859-2e295ebd5f7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 May 05 14:00:33.357865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 398/811] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:33.370855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:33.378695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:33.380710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:33.382071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-89d030f4-ba69-427c-a012-19f366dbcdcd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.156116 May 05 14:00:33.382630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 414/812] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:33 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:34.370856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:34.371930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:34.379290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:34.379744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:34.380568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:34.381011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:34.400562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:34.401177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:34.407500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:34.407954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:34.408724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:34.409167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:34.411274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d36b1046-e7fc-4f36-91ca-f7a82bd78b90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 May 05 14:00:34.411841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 399/813] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:34.536548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:34.544271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:34.545758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:34.546939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-89f8dc2d-106e-4c93-b71b-ed83ad5e1efd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.150271 May 05 14:00:34.547499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 415/814] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:34 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:35.423388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:35.424337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:35.431575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:35.432041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:35.432939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:35.433379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:35.463901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2171df18-243a-4991-ac78-4dc0b503e556 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 May 05 14:00:35.464459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 400/815] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:35.569142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:35.569760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:35.576237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:35.576687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:35.577457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:35.577902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:35.716170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:35.724487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:35.725989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:35.727179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-03e60e77-9320-4942-a462-28864f26089e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.162523 May 05 14:00:35.727761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 416/816] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:35 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:36.476272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:36.477121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:36.483432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:36.483879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:36.484637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:36.485076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:36.513922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e5eb27dd-95ec-422a-b52b-71a9e2fb5c01 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042194 May 05 14:00:36.514506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 401/817] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:36.744693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:36.745299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:36.751668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:36.752133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:36.752895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:36.753332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:36.886228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:36.893892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:36.895416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:36.896577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-56d43762-699e-4ea5-b288-9b7bb9396f3f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.155950 May 05 14:00:36.897126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 417/818] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:36 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:37.524943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:37.525784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:37.532192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:37.532644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:37.533398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:37.533829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:37.564174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e8a3718-f8db-46f4-898d-6f39ce632d59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 May 05 14:00:37.569086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 402/819] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:37.915370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:37.915989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:37.922282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:37.922735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:37.923504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:37.923940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:38.047051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:38.054631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:38.056121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:38.057281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a88eae35-f7fe-4060-b29c-c8b8b7fed0cc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.145870 May 05 14:00:38.057828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 418/820] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:37 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:38.575172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:38.576099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:38.582525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:38.582976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:38.583740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:38.584175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:38.611818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db30faeb-e9da-4aa2-b53b-a465cb0f0f24 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040676 May 05 14:00:38.612352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 403/821] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:39.075289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:39.075920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:39.082813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:39.083261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:39.084019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:39.084454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:39.212016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:39.219880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:39.221359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:39.223069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d1468b88-ff4d-48aa-8bb7-1a34f813f715 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.151171 May 05 14:00:39.223617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 419/822] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:39 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:39.623775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:39.624703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:39.631556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:39.632009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:39.632778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:39.633230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:39.661681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76bb6787-ce34-4798-a6f5-8133813397e0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041851 May 05 14:00:39.662255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 404/823] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:40.241258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:40.241848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:40.248263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:40.248720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:40.249499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:40.249950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:40.376796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:40.384752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:40.386283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:40.387448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ed068cd0-9533-4bdc-b760-18463b95ad62 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.150741 May 05 14:00:40.388010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 420/824] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:40 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:40.680542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:40.680542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:40.681164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:40.681164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:40.681935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:40.682403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:40.710546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5296e5fe-ac2a-495d-bedb-1e33f32b8bc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041252 May 05 14:00:40.715125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 405/825] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:41.405704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:41.406350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:41.414865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:41.415145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:41.415931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:41.416377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:41.548497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:41.556854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:41.558374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:41.559514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dc52fa2f-308d-408e-985e-3b303203f534 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.157677 May 05 14:00:41.560075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 421/826] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:41 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:41.722940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:41.723815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:41.730287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:41.730736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:41.731535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:41.731972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:41.771021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f1528c95-0cc2-4b2e-a37c-7670a78ad803 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052401 May 05 14:00:41.772007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 406/827] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:42.578231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:42.578851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:42.585881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:42.586367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:42.587132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:42.587573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:42.711735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:42.725317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:42.726955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:42.728111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b253bc69-dc0e-418f-83f7-782e12db5b6b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.153853 May 05 14:00:42.728658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 422/828] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:42 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:42.787634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:42.788576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:42.795064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:42.795541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:42.796308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:42.796740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:42.826368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-554742f4-fff2-4b84-a505-06a104928d03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 May 05 14:00:42.826911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 407/829] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:43.746468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:43.747037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:43.753476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:43.753951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:43.754765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:43.755226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:43.838836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:43.840257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:43.847140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:43.847689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:43.849115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:43.849856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:43.877652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bd8498d1-5d74-4a5a-8ea1-bd4109365a78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 May 05 14:00:43.878225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 408/830] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:43.887562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:43.896174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:43.897654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:43.898839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5de8ea70-4786-4b10-9299-60d22ffafcf4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.156579 May 05 14:00:43.899393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 423/831] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:43 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:44.889273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:44.890229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:44.896739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:44.897354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:44.898146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:44.898585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:44.917102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:44.917722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:44.924285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:44.924707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:44.925498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:44.925970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:44.929135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67b97c90-fefc-4502-9db8-23b8aecd76c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043764 May 05 14:00:44.929701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 409/832] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:45.056919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:45.064785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:45.066313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:45.067470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6026ba57-3924-49e2-bc9f-9d2601b5fafc tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.154341 May 05 14:00:45.068023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 424/833] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:44 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:00:45.178517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:45.179014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:45.184879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.185330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.186136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.186565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.304420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lazy-loading 'services' on Instance uuid 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:00:45.550751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d2604818-e35e-426b-827d-f732304ee6bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments/8dbdb1bf-63db-4ceb-9e3a-f59742f524bc" status: 202 len: 0 microversion: 2.1 time: 0.375964 May 05 14:00:45.551339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 410/834] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:00:45 2022] DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments/8dbdb1bf-63db-4ceb-9e3a-f59742f524bc => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:00:45.559625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:45.560770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:45.566892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.567838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.568603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.569037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.598183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9ca51cc6-d992-4c12-9cd2-148b4a59a92b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042402 May 05 14:00:45.598736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 425/835] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:45.941483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:45.943122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:45.949439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.949889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.950681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:45.951136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:45.979870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-df4d93cd-5bfb-4d1d-a1db-bc9b81d2af34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 May 05 14:00:45.980777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 411/836] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:46.085365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:46.085983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:46.092635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:46.093096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:46.093883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:46.094358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:46.217823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:46.226069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:46.227576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:46.228741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7307b7ec-4761-4ead-b824-cce30131b9c2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.147292 May 05 14:00:46.229294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 426/837] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:46 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:46.609734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:46.610715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:46.616940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:46.617452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:46.618263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:46.618685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:46.650441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef69f13f-6446-4d5b-9148-9fbc0ed30704 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 May 05 14:00:46.650998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 412/838] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:46.992206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:46.993162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:46.999283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:46.999840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.000604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:47.001040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.029648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-79d32e1d-856f-49e5-b10d-8b829efc0fe9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 May 05 14:00:47.030219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 427/839] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:47.246582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:47.247097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:47.253338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:47.253788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.255081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:47.255523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.566984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:47.575381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:47.576869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:47.578040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f8f29409-ce1e-47b0-aba5-53ec1dcd0bd7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.335386 May 05 14:00:47.578589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 413/840] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:47 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:47.663353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:47.664340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:47.670829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:47.671231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.671955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:47.672393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:47.704029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d691cb54-4d29-4446-a166-339db0702a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 May 05 14:00:47.704603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 428/841] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:48.041230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:48.042239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:48.049220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.049678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.050488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.050937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.079406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b06a7d0-a8a7-40a3-a621-ed123a4c87b6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 May 05 14:00:48.079991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 414/842] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:48.596784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:48.597390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:48.603367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.603815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.604573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.605010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.716511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:48.717534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:48.724741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.725791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.726575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:48.727018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:48.732770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:48.741612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:48.743492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:48.744662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee58e1b1-99ce-40e7-ae6e-9e4d85e214d6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.151803 May 05 14:00:48.745751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 429/843] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:48 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:48.758280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-906dde91-dc0e-4139-87eb-7d50f66924b4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 May 05 14:00:48.762501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 415/844] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:49.091414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:49.092374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:49.098536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.098995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.099817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.100258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.129419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-006b0686-eca6-44fa-937f-861bc0731922 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 May 05 14:00:49.130571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 430/845] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:49.763684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:49.764296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:49.771245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.771644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:49.772089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.772448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.772629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:49.772883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.778515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.778962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.779732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:49.780169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:49.815768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8d415606-1ff0-4e33-997d-6a8c6b3f83f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048466 May 05 14:00:49.816519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 431/846] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:49.909734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:49.918125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:49.919615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:49.920799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-93062463-b7d2-4e8b-a4d9-9ec3a81608bd tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.161116 May 05 14:00:49.921347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 416/847] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:49 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:50.141447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:50.142398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:50.149101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.149560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:50.150346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.150782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:50.181714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cfba7a44-5c48-4f44-b30c-3db38978715d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 May 05 14:00:50.182294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 432/848] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:50.828926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:50.829891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:50.836559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.837014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:50.837782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.838257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:50.869349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bd6ec549-9ade-464e-804c-92d31a138ce7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 May 05 14:00:50.869516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 417/849] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:50.938593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:50.939206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:50.945409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.945882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:50.946664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:50.947099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:51.076729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:51.085264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:51.086873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:51.088170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e9f81fb3-a6d1-48a9-9465-d7d3cd0bc7b2 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.153409 May 05 14:00:51.088724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 433/850] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:50 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:51.192827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:51.193756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:51.199668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:51.200113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:51.200901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:51.201374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:51.229730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7acad2c8-1d3b-49e0-875f-7cdff553cfa6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040869 May 05 14:00:51.230293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 418/851] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:51.881209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:51.882456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:51.889852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:51.890374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:51.891139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:51.891582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:51.920003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d79681d9-ffe2-4c8d-a86d-1fbe264ec903 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 May 05 14:00:51.920555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 434/852] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:52.106891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:52.107576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:52.113799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.114782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.115633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.115981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.241615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:52.242142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:52.242659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:52.249289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.249769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.250575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.250683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:52.251012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.252296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:52.253463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ad52da79-9a6f-4301-b51a-8c186a386227 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.150434 May 05 14:00:52.254035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 419/853] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:52 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:52.278846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67f7e1a7-3c79-4ac9-a6ae-a6e33f0a3d7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 May 05 14:00:52.279383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 435/854] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:52.930694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:52.931616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:52.937480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.937924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.938722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:52.939155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:52.969655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b8d2c58d-cfbd-4792-aefc-c4548fe42260 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 May 05 14:00:52.970233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 420/855] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:53.272784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:53.273386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:53.279816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.280272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:53.281060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.281497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:53.290073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:53.290995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:53.297223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.297669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:53.298482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.298917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:53.329641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b955a9d6-3b50-46fa-81b5-3eeab836e71b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 May 05 14:00:53.330222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 421/856] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:53.415656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:53.423351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:53.424847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:53.426000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-348a77b6-44ee-44ce-be5b-3295b158a742 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.158139 May 05 14:00:53.426582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 436/857] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:53 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:53.981398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:53.982434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:53.988809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.989268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:53.990035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:53.990573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:54.019263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9da55b9c-dd22-49b8-ae18-c800f9d1eeb9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 May 05 14:00:54.019816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 422/858] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:54.341362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:54.342315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:54.349211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:54.349664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:54.350489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:54.350929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:54.380439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b5d22d80-53f4-4c36-8be3-dfb20bd20863 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 May 05 14:00:54.380984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 437/859] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:54.443161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:54.443796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:54.450103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:54.450554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:54.451307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:54.451741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:54.578625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:54.586412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:54.587872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:54.589019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e242b4cf-2cf3-43ec-b806-364bccebae61 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.149778 May 05 14:00:54.589572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 423/860] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:54 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:55.031279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:55.032204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:55.038173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.038627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.039390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.039831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.069415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1d25233f-1b1e-4564-a3eb-407c74e93bbf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 May 05 14:00:55.069969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 438/861] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:55.392332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:55.393266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:55.399698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.400327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.400918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.401356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.430943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e48e495b-4630-4ddf-a7ec-16e26ba66a9c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 May 05 14:00:55.431486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 424/862] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:55.608107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:55.608713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:55.614992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.615439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.616192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:55.616625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:55.750922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:55.759636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:55.761117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:55.762332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-80265cbf-d610-4adb-8808-b3df8a4b5abe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.158043 May 05 14:00:55.762883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 439/863] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:55 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:56.081048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:56.082041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:56.088382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.088837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.089601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.090063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.120297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd393636-2740-4940-b6a3-63e79f90cea9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 May 05 14:00:56.120852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 425/864] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:56.442451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:56.443343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:56.449319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.449784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.450569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.451014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.479359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1cf6c10a-5e3b-4048-bbdd-6478e855a0c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041012 May 05 14:00:56.479901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 440/865] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:56.781129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:56.781667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:56.787561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.788005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.788823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:56.789325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:56.918756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:56.928702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:56.930762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:56.931957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a55db7d9-6f9a-4bdd-9b31-0b933ef425a1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.155065 May 05 14:00:56.932507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 426/866] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:56 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:57.131911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:57.132847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:57.139227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.139688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:57.140461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.140904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:57.170482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4385efb6-ab2e-407c-88ae-bd8c8bd181e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042526 May 05 14:00:57.171049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 441/867] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:57.491568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:57.492413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:57.498989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.499432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:57.500195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.500627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:57.529654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-42d9c33e-4fe3-44f6-9576-7a50a3524194 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042197 May 05 14:00:57.530247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 427/868] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:57.950956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:57.951564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:57.957485 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.957932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:57.958719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:57.959156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:58.082313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:58.090706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:58.092200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:58.093372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69f38f2e-7263-423b-8b81-2101c4128375 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.146289 May 05 14:00:58.093925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 442/869] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:57 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:58.182118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:58.183055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:58.189114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:58.189571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:58.190377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:58.190821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:58.220529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa6f8321-aa99-4d17-800a-5ba31879732d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 May 05 14:00:58.221295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 428/870] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:58.542536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:58.543383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:58.550097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:58.550497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:58.551283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:58.551734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:58.581978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a0207c6e-9be5-4f41-9822-ac9f7961ea45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043422 May 05 14:00:58.582556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 443/871] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:00:59.112798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:59.113409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:59.120124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.120576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.121337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.121775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.232527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:59.233490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:59.239526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.239985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.240755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.241199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.249983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:59.258737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:59.260225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:00:59.264035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7412b2f9-0a30-46eb-865b-a50614919ce8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.155190 May 05 14:00:59.264607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 429/872] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:00:59 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:00:59.276530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dde70319-8b76-40fa-a25c-4f1652f34f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 May 05 14:00:59.277096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 444/873] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:00:59.595456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:00:59.596876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:00:59.606261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.606929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.608132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:00:59.608823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:00:59.639758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-917270f8-91ca-448d-a4b8-1a2f4172b77f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050285 May 05 14:00:59.640305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 430/874] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:00:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:00.283012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:00.283627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:00.287745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:00.288660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:00.289983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.290533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.291309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.291749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.294834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.295282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.296037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.296513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.327164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f7467af5-ed9e-4dc3-8212-d824143b7064 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 May 05 14:01:00.327931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 431/875] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:00.420883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:00.428653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:00.430758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:00.431908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c16eb1e5-3827-490c-b681-bfe14c9f1fea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.152867 May 05 14:01:00.432461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 445/876] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:00 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:00.651452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:00.652313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:00.658250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.658705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.659455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:00.659890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:00.689005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9c633e7f-5a06-441b-a639-55f5007a0bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 May 05 14:01:00.689560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 432/877] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:01.339502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:01.340601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:01.347096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.347551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.348324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.348756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.377987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ce3bea71-b97d-4fd6-99b4-f251c40df670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 May 05 14:01:01.382063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 446/878] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:01.449659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:01.450298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:01.456513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.456966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.457730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.458203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.587357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:01.595376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:01.596857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:01.598007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6dd9a498-350c-443a-907a-4836f1a14d9e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.152278 May 05 14:01:01.598572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 433/879] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:01 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:01.701151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:01.702003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:01.707924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.712587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.712587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:01.712587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:01.737106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-38d38e85-e7ae-4cff-979a-5e197842f3d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039947 May 05 14:01:01.737643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 447/880] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:02.388579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:02.389499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:02.395309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.395762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.396520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.396955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.425518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f2b63aa3-eb1f-440a-9975-499ab07da850 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040811 May 05 14:01:02.426082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 434/881] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:02.615547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:02.616169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:02.622651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.623053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.623823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.624269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.747645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:02.748569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:02.752168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:02.754893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.755349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.756110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:02.756542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:02.760626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:02.762139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:02.763289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dabe248b-d40f-481b-81ec-905d5a8707b8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.151640 May 05 14:01:02.763835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 448/882] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:02 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:02.785792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b9e5834-54dd-40b7-b833-ee8fe6f5da07 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042042 May 05 14:01:02.787437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 435/883] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:03.436615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:03.437549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:03.443447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.443898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.444666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.445104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.472980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0f95f77c-380b-4a87-864b-b0e914e8b545 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040259 May 05 14:01:03.473526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 449/884] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:03.783259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:03.783783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:03.790845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.791313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.792068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.792506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.796468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:03.797460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:03.803510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.803961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.804748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:03.805182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:03.832860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-22779fc3-60a2-40aa-9410-e19729193a32 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040140 May 05 14:01:03.833428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 450/885] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:03.917283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:03.925018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:03.926532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:03.927687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7b07f865-9be8-489f-bb5e-6147a1f046b7 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.148462 May 05 14:01:03.928235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 436/886] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:03 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:04.484751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:04.485672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:04.491575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.492510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:04.493265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.493697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:04.521736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-05a24bcc-deb5-46df-a43e-539ac8bd0083 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040930 May 05 14:01:04.522300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 451/887] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:04.845001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:04.845939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:04.852813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.853264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:04.854083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.854646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:04.887028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7dd5011a-d693-4adb-be3b-516e3d72f07b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 May 05 14:01:04.887585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 437/888] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:04.945950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:04.946595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:04.953059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.953512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:04.954316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:04.954765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:05.082860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:05.091380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:05.092986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:05.094526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe852cfb-5f6b-47d4-a320-65fda57cfb4a tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.152952 May 05 14:01:05.095353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 452/889] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:04 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:05.533256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:05.534238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:05.540115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:05.540564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:05.541345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:05.541786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:05.571514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c262d032-608b-42df-91cd-bf0ee5f15c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042192 May 05 14:01:05.572118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 438/890] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:05.898539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:05.899504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:05.905430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:05.905891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:05.906682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:05.907124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:05.935952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f58722d-387e-4729-9056-f3d1ff95a01a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 May 05 14:01:05.936498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 453/891] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:06.112442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:06.113053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:06.120065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.120514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.121273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.121705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.250176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:06.257775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:06.259339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:06.260494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1739b9b9-f068-4682-9a56-082158818f39 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.152230 May 05 14:01:06.261042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 439/892] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:06 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:06.583273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:06.584153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:06.590889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.591341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.592095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.592530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.620977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0c73b6c7-79ec-475f-abe1-de65132d289d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041701 May 05 14:01:06.621518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 454/893] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:06.948137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:06.949064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:06.955174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.955627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.956520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:06.956999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:06.986585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-941ec946-5f20-4a5d-a72c-a30588faf3f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043043 May 05 14:01:06.987124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 440/894] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:07.277979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:07.278531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:07.284309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:07.284759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:07.285520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:07.285957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:07.412091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:07.420326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:07.421838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:07.423030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fdfeda3a-20d9-43ba-9d70-fe1836430cab tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1738 microversion: 2.20 time: 0.149062 May 05 14:01:07.423577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 455/895] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:07 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 05 14:01:07.631967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:07.634613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:07.640837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:07.641313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:07.642129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:07.642693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:07.673423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-084abe3d-0c67-4274-a867-63465bd1ffd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045513 May 05 14:01:07.674921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 441/896] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:07.999673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:08.000829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:08.007560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.011961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.011961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.011961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.038236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83c4e7af-236d-4632-a09b-da92da7b8da9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 May 05 14:01:08.040612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 456/897] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:08.440705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:08.441448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:08.447320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.448279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.448524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.449012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.685200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:08.686501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:08.692451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.692804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.693592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.694042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.724828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-800b61ae-bf2f-4b6f-a380-71e3698934df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 May 05 14:01:08.725379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 457/898] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:08.851879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:08.858359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:08.859417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:08.860703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:08.862283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:08.863514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e8f7cce-6e63-417e-bfda-0569663d4471 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1720 microversion: 2.20 time: 0.426703 May 05 14:01:08.864228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 442/899] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:08 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1720 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:08.867687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.868258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.869586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.870230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.902184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6505eab6-d1c7-451d-aa1e-f10593f26061 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049410 May 05 14:01:08.904051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 458/900] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:08.912661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:08.913231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:08.919563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.920075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.921106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:08.921692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:08.950882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65a97041-a22f-49fe-aa2d-4256eb627b1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 200 len: 194 microversion: 2.1 time: 0.042192 May 05 14:01:08.951628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 443/901] 10.222.0.26 () {58 vars in 1412 bytes} [Thu May 5 14:01:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:09.050781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:09.051947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:09.058837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.063413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:09.063413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.063413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:09.089871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-abc3a532-83ab-4f89-b8f2-6e7369e79023 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 May 05 14:01:09.090703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 459/902] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:09.737249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:09.739297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:09.748203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.748662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:09.749437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.749872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:09.790979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-27962a0e-d23d-492d-b72d-d4e23b5cd987 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057797 May 05 14:01:09.796910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 444/903] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:09.882124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:09.883962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:09.889970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.890558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:09.891375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:09.892045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.112956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:10.114922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:10.122649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.123183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.124022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.124529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.153321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0ace3f47-1abd-49f1-8696-75dc711050c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052507 May 05 14:01:10.153804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 445/904] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:10.209704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:10.219472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:10.221201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:10.222501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c5575316-03f3-4b3f-918c-82345da46ab6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1720 microversion: 2.20 time: 0.344931 May 05 14:01:10.223171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 460/905] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:09 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:10.223293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:10.223744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:10.230199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-6060d4e0-6302-429b-aa91-86028aa56031 req-6ca60c2b-35c3-40db-b512-f11e094c6ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:01:10.230637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.231036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.231814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.232251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.239918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-6060d4e0-6302-429b-aa91-86028aa56031 req-6ca60c2b-35c3-40db-b512-f11e094c6ec1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.240368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-6060d4e0-6302-429b-aa91-86028aa56031 req-6ca60c2b-35c3-40db-b512-f11e094c6ec1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.252882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-6060d4e0-6302-429b-aa91-86028aa56031 req-6ca60c2b-35c3-40db-b512-f11e094c6ec1 service nova] Creating event network-changed:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 14:01:10.258312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-6060d4e0-6302-429b-aa91-86028aa56031 req-6ca60c2b-35c3-40db-b512-f11e094c6ec1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033548 May 05 14:01:10.259089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:01:10.259347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 461/906] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:10.569410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-90bcbd9e-26ff-4ed7-8412-2ef7c88a98c4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 204 len: 0 microversion: 2.1 time: 0.349618 May 05 14:01:10.570921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 446/907] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:01:10 2022] DELETE /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 05 14:01:10.580132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:10.580835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:10.588109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.588960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.589342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.590007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.732998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:10.740636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-60d9086a-f170-4651-9786-30291c606a91 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.165016 May 05 14:01:10.741203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 462/908] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:10.806118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:10.807050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:10.813335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.813788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.814579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:10.815024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:10.844453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd28823c-93c0-4a33-a20a-d1a6b3e264ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 May 05 14:01:10.845004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 447/909] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:11.165029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:11.166324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:11.173322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.173902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.174789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.175237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.207439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7fba5879-490c-4425-897c-158bbb6df72f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 May 05 14:01:11.208272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 463/910] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:11.240942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:11.241557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:11.248967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.249414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.250274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.250714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.379213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:11.387560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:11.389063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:11.390268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6825145b-9099-4f3c-8264-9ba6a96fe587 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1720 microversion: 2.20 time: 0.153446 May 05 14:01:11.390830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 448/911] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:11 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:11.559392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-d52e32b0-4dc8-4f5a-af17-b835eace9679 req-3cb8af84-a8e9-4d3c-a07a-3a5ff8b5a503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "name": "network-vif-unplugged", "status": "completed", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:01:11.567481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d52e32b0-4dc8-4f5a-af17-b835eace9679 req-3cb8af84-a8e9-4d3c-a07a-3a5ff8b5a503 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.570563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d52e32b0-4dc8-4f5a-af17-b835eace9679 req-3cb8af84-a8e9-4d3c-a07a-3a5ff8b5a503 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.579414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-d52e32b0-4dc8-4f5a-af17-b835eace9679 req-3cb8af84-a8e9-4d3c-a07a-3a5ff8b5a503 service nova] Creating event network-vif-unplugged:eda82bc2-7da3-440e-8aee-53635c08bbe1 for instance 93818186-77bc-406b-8664-b67f320534c5 on hv-cinder-73761 May 05 14:01:11.584263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-d52e32b0-4dc8-4f5a-af17-b835eace9679 req-3cb8af84-a8e9-4d3c-a07a-3a5ff8b5a503 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030136 May 05 14:01:11.584848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 464/912] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:11.758930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:11.759546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:11.765808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.766375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.767138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.767576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.856902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:11.858040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:11.864216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.864778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.865626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:11.866176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:11.900972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-79df7281-4ab2-42ad-a39e-9085d9cf2606 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048186 May 05 14:01:11.902002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 465/913] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:11.907166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:11.915650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-17c13b0d-b11f-4d06-a5b9-0fb405188201 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.160733 May 05 14:01:11.916289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 449/914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:12.219856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:12.220783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:12.227889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.228339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.229104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.229540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.258421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ee31345-e0d0-42ed-a534-09252186d4d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042660 May 05 14:01:12.258985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 466/915] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:12.408673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:12.409195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:12.415667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.416114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.416867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.417299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.548863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:12.556841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:12.558358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:12.559508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e9266d48-7e28-4a86-827e-75fea457be57 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1720 microversion: 2.20 time: 0.154945 May 05 14:01:12.560052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 450/916] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:12 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:12.912195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:12.913123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:12.919201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.919650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.920420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.920855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.936344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:12.936971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:12.943396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.943781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.944559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:12.945640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:12.952471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-293ee0d7-08d5-453a-970a-188fcbd326dc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 May 05 14:01:12.953049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 467/917] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:13.079784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:13.089730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ad3facf-a0fd-40f8-b6c4-bb82acd37d5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.157127 May 05 14:01:13.099791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 451/918] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:13.270238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:13.271073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:13.277668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.278166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.278944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.279418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.308236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a774c207-4970-407b-b151-8e244d7e2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 May 05 14:01:13.308786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 468/919] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:13.578543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:13.579518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:13.586053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.586519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.587297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.587741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.746064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:13.754149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:13.755816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'add9c19abc0a46feb0be090a9a6641c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8536ba08456944f5a554574f98c72fb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:13.757000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-77a6e279-450d-4bc2-a183-c455b356e9ea tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 200 len: 1723 microversion: 2.20 time: 0.182698 May 05 14:01:13.758185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 452/920] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:01:13 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 05 14:01:13.775103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f466cd5-2b53-433a-9c05-5d2b17f46e6b"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:01:13.776180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:13.790387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.790929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.792381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.793031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.964037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:13.965887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:13.972751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.973213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:13.974006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:13.974479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.010658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-748c0c94-d007-4882-ab62-8fb9eff56866 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050486 May 05 14:01:14.011483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 453/921] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:14.108184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:14.108804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:14.115245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:14.115695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.116474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:14.117468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.352752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:14.373065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d18803bc-33e1-41e8-9196-b83786e5d5ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1567 microversion: 2.1 time: 0.260398 May 05 14:01:14.373065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 454/922] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:14 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1567 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:14.373065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:14.373065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:14.378800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:14.379453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.380228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:14.380928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.410030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-22037eb4-19c5-474d-8deb-3e54ab8f40fa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 May 05 14:01:14.410771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 455/923] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:14.661867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-00478a64-4be2-4aa1-a1e8-8d150dbaa6ff req-555a5abb-3a33-45f8-a190-5a4a6fe36476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c3e07b2-6689-45b9-9da1-000c29490f34", "name": "network-vif-deleted", "tag": "10d1391a-2f29-4d69-9c8f-59e13abd9391"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:01:14.670128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-00478a64-4be2-4aa1-a1e8-8d150dbaa6ff req-555a5abb-3a33-45f8-a190-5a4a6fe36476 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:14.670589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-00478a64-4be2-4aa1-a1e8-8d150dbaa6ff req-555a5abb-3a33-45f8-a190-5a4a6fe36476 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:14.681493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-00478a64-4be2-4aa1-a1e8-8d150dbaa6ff req-555a5abb-3a33-45f8-a190-5a4a6fe36476 service nova] Creating event network-vif-deleted:10d1391a-2f29-4d69-9c8f-59e13abd9391 for instance 3c3e07b2-6689-45b9-9da1-000c29490f34 on hv-cinder-73761 May 05 14:01:14.686839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-00478a64-4be2-4aa1-a1e8-8d150dbaa6ff req-555a5abb-3a33-45f8-a190-5a4a6fe36476 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028812 May 05 14:01:14.687795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 456/924] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:14.968490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7e8d7bbd-9b97-4615-bab8-8f38deb455af tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "POST /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.197271 May 05 14:01:14.969497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 469/925] 10.222.0.26 () {62 vars in 1363 bytes} [Thu May 5 14:01:13 2022] POST /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments => generated 188 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 14:01:15.022099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:15.023162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:15.029909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.030411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.031201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.031646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.064205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-af595c40-6135-47c5-98fb-d431dff1de81 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 May 05 14:01:15.064821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 457/926] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:15.384660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:15.385283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:15.391693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.392154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.392937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.393380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.422132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:15.423086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:15.428994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.429445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.430243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:15.430683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:15.455706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:15.459349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b3740759-2ca3-45f8-82c8-4209703062c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 May 05 14:01:15.459908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 458/927] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:15.463924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b3120e14-a333-48ba-8a59-af49e73ef8c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083885 May 05 14:01:15.464486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 470/928] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:16.076203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:16.077139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:16.083525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.083983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.084751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.085197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.115489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cb326fed-af15-48a3-89b8-b141e8bae50d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 May 05 14:01:16.116041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 459/929] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:16.471779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:16.472703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:16.479090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.479544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.480303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.480429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:16.480739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.481019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:16.486846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.487302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.488076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:16.488519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:16.510854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec03f8eb-fd0c-48e4-a227-ce9c7b8400a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 May 05 14:01:16.511414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 471/930] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:16.549582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:16.557455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2d2521e8-90f6-44ac-a337-f4e5c6560075 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080872 May 05 14:01:16.558021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 460/931] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:16 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:17.126933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:17.127856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:17.134266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.134719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.135473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.135904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.321985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a37f4bb6-c7d9-4d98-b654-bd58ccec7e50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198923 May 05 14:01:17.322543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 472/932] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:17.523935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:17.524924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:17.531962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.532438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.533840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.534712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.571232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a305bd2-030e-4d63-a8cf-0b1a241046ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051877 May 05 14:01:17.573150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 461/933] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:17.574810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:17.575655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:17.582289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.582742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.583527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:17.583967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:17.648817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:17.656446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6dede4cf-0783-4039-8ba3-7c33963c215f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.086305 May 05 14:01:17.657014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 473/934] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:17 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:18.332772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:18.333698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:18.340387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.341093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.341856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.342338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.371391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed7a954d-e1f5-42a8-bab6-e90d4bcd65bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042539 May 05 14:01:18.371873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 462/935] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:18.582910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:18.583839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:18.591092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.591542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.592452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.592907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.620228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2808df7d-bcdd-424c-bdae-4cb9b812ecfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 May 05 14:01:18.620761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 474/936] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:18.675860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:18.675860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:18.680322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.680774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.681548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:18.681987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:18.745699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:18.753232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac49adb1-c30d-4300-ae6b-83c03551401c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084565 May 05 14:01:18.753796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 463/937] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:19.383449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:19.384321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:19.390241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.390691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.391452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.391884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.419913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4518c070-8109-4b6a-a350-5f86e74abfad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 May 05 14:01:19.420440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 475/938] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:19.631674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:19.633294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:19.639610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.640032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.640782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.641224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.668555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ab4a3a0-0738-4cf9-9337-48939c7c746e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 May 05 14:01:19.669105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 464/939] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:19.769912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:19.770556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:19.776587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.777035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.777795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:19.778267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:19.841019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:19.852062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-24c5f3ff-1a63-430d-961b-475e866ab34e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.086061 May 05 14:01:19.853375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 476/940] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:19 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:20.431356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:20.432236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:20.438565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.439019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.439789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.440226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.468876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2d269dad-1e51-4672-829d-d68a31e6cec7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042039 May 05 14:01:20.469421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 465/941] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:20.680638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:20.685584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:20.687566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.688020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.688792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.689233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.716796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e668f977-95e5-4788-b1e7-a4bd0e3910b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040725 May 05 14:01:20.717333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 477/942] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:20.869778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:20.870412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:20.876391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.876837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.877592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:20.878034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:20.937155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:20.944379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-81804383-098b-4fab-bb25-b51d074420d0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079097 May 05 14:01:20.944940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 466/943] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:20 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:21.480666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:21.481600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:21.488045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.488500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:21.489271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.489711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:21.518103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-44ad1c44-ad36-4d5c-9cf3-429619ae0371 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041418 May 05 14:01:21.518644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 478/944] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:21.728445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:21.729376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:21.735836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.736231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:21.736998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.737441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:21.765795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0b1b0e53-c964-482b-a4bb-90d99f55d0ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041353 May 05 14:01:21.766379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 467/945] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:21.960580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:21.961200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:21.968035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.968490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:21.969265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:21.969707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:22.030497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:22.037831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-05e41c71-da66-4952-b21b-6bb2427711c5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081139 May 05 14:01:22.038422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:21 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:22.530698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:22.531657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:22.537618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:22.538108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:22.538874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:22.539311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:22.567548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-803b2cf4-4a79-47cc-964f-d5cb7e4d3f01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040825 May 05 14:01:22.568085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 468/947] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:22.777260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:22.778258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:22.789923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:22.789923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:22.789923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:22.789923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:22.813547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-013a43ce-976b-48be-a018-ab095c3ca052 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040762 May 05 14:01:22.814107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 480/948] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:23.054709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:23.055783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:23.062029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.062485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.063247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.063678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.124367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:23.131627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e7ccecef-ec29-4636-9384-a15ffc070f35 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080868 May 05 14:01:23.132181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 469/949] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:23 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:23.579534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:23.580465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:23.586978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.587395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.588156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.588593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.617138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa531ae9-2d0f-4e1b-8490-4e5a66eadf35 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 May 05 14:01:23.617685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 481/950] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:23.824828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:23.825787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:23.831847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.832248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.833012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:23.833449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:23.866707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e829db2e-bc94-4e6c-a9eb-4efb63978264 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 May 05 14:01:23.867423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 470/951] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:24.149791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:24.150436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:24.156826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.157281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.158079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.158527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.220942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:24.228415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2b54d0da-a243-4a11-b6e9-225b1cf0780d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083046 May 05 14:01:24.228975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 482/952] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:24.628658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:24.629547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:24.636476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.638219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.638219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.638219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.667859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8c80137e-9f54-437d-9082-1153069e128e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 May 05 14:01:24.668409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 471/953] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:24.878959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:24.879855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:24.885948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.886427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.887198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:24.887638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:24.917602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a3efd8cc-3d54-4a27-9f11-42748daf41ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 May 05 14:01:24.918175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 483/954] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:25.244629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:25.245173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:25.251125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.251584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.252350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.252793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.312820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:25.320192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-090ca588-83d9-4f00-b3c6-08d66f4494f0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079495 May 05 14:01:25.320749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 472/955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:25.679007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:25.679934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:25.686308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.694140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.694140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.694140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.717173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-516868b1-269b-46fa-b44f-b1b3444a8439 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042071 May 05 14:01:25.717747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 484/956] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:25.928838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:25.929833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:25.936705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.937162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.937933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:25.938409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:25.966538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3852d8d9-3860-469b-941d-957870429912 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041664 May 05 14:01:25.967084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 473/957] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:26.336652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:26.337265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:26.343473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.343924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:26.344688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.345127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:26.404946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:26.412239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-de472ca6-61f8-4e7e-aa84-bcc538be4ea8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079427 May 05 14:01:26.412784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 485/958] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:26 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:26.728743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:26.729677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:26.735639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.736096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:26.736866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.737310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:26.766211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9d66a152-e3b7-4701-8921-d9d52a017c05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042001 May 05 14:01:26.766753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 474/959] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:26.978098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:26.978946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:26.985202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.986162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:26.986430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:26.986865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:27.014592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d64c13f1-e262-47f8-9eb5-c65486cbf4c2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040591 May 05 14:01:27.015126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 486/960] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:27.428443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:27.429060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:27.435857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:27.436303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:27.437059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:27.437494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:27.497452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:27.504769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-340b415f-b046-4144-a48e-df8b68505f84 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080200 May 05 14:01:27.505332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 475/961] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:27 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:27.777743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:27.778635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:27.784555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:27.785010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:27.785783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:27.786254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:27.814786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2ea0fb38-02da-4027-8b1c-58f8e049b182 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041140 May 05 14:01:27.815355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 487/962] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:28.026259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:28.027245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:28.033176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.033566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.034353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.034788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.063538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46c2a901-a9d9-429c-bf50-5b1b76034be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041445 May 05 14:01:28.064081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 476/963] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:28.521412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:28.522077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:28.528950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.529423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.530250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.530687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.593611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:28.601141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ece2bdfc-caf0-4899-90f0-5df7de174806 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083538 May 05 14:01:28.601697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 488/964] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:28 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:28.826593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:28.827560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:28.833403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.833862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.834673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:28.835118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:28.864973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc4014c5-c188-422c-affe-02b58c1e07c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042440 May 05 14:01:28.865512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 477/965] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:29.075096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:29.076033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:29.082062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.082477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.083250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.083693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.113293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a77686ee-be73-4c61-bc49-1179fbc6f1b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 May 05 14:01:29.113842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 489/966] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:29.618348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:29.618985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:29.625321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.625783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.626566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.627008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.695134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:29.702616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a810b445-2ba9-41c6-b32d-bb0b5d046e3e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.088366 May 05 14:01:29.703174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 478/967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:29 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:29.877126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:29.877993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:29.886304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.886789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.887565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:29.888010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:29.932783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-78714331-8ce1-41e0-a5bd-dda6d17fb521 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059676 May 05 14:01:29.933329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 490/968] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:30.125309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:30.126262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:30.133690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.133690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.133690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.133990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.161184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d1bebc72-1d88-41d6-9b78-4082b1b09ac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039920 May 05 14:01:30.161723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 479/969] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:30.720459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:30.721169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:30.727147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.727596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.728348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.728786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.788738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:30.796079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cbe22d8c-0cc6-40b7-aeb1-09a890fb06af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079830 May 05 14:01:30.796635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 491/970] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:30.944455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:30.945293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:30.953133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.953588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.954390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:30.954831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:30.983373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c6660188-d74f-49c2-aa14-fae544bf5bf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 May 05 14:01:30.983915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 480/971] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:31.172837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:31.173770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:31.180628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:31.181099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:31.181860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:31.182324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:31.210898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-077c1b3f-dad1-4c3b-81d9-e587dd810b2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 May 05 14:01:31.211372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 492/972] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:31.812337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:31.812949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:31.818919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:31.819373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:31.820133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:31.820568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:31.880133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:31.887451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-acf5e3c0-5555-4408-8843-715f498dfba3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078979 May 05 14:01:31.887996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 481/973] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:31 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:31.994523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:31.995480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:32.001323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.001769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.002638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.003074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.031059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d9368639-6895-4acc-a0fa-8daa5ca5011f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040535 May 05 14:01:32.031583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 493/974] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:32.222987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:32.223896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:32.230283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.230741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.231508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.231949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.259939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f3232174-6f5f-4641-8216-467a3bda2325 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 May 05 14:01:32.260481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 482/975] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:32.904027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:32.904588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:32.911688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.912137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.912894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:32.913332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:32.973438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:32.982633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-630bbb95-3a4c-41a9-b640-9f348e332cc3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082472 May 05 14:01:32.984738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 494/976] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:32 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:33.042935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:33.043867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:33.049938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:33.050414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:33.051170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:33.051604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:33.079822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-adc5e489-8742-4c2e-a155-0ef0c728e01e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 May 05 14:01:33.080360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 483/977] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:33.271589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:33.272426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:33.278352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:33.278806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:33.279562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:33.279994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:33.308290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-81233b96-36ca-4089-83f4-8b8b31874831 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040794 May 05 14:01:33.308831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 495/978] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:33.999131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:33.999750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:34.006114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.006567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.007334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.007772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.069562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:34.077570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-98ba7df1-d900-4e2b-a884-3d9044bcb052 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082311 May 05 14:01:34.078146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 484/979] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:33 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:34.091863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:34.092822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:34.099131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.099581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.100351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.100791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.129485 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ca398acb-81bc-4307-98c2-2765c838686a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 May 05 14:01:34.130033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 496/980] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:34.319727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:34.320573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:34.327080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.327534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.328287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:34.328716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:34.355842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-394172c4-4d90-427b-b731-7994ca99c7c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040174 May 05 14:01:34.356375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 485/981] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:35.095219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:35.095832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:35.102306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.102756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.103522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.103989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.140854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:35.141792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:35.148256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.148711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.149501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.149934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.165432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:35.172676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-32c5cb1a-e4ac-4c7e-9498-8971c51fe758 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081621 May 05 14:01:35.173232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 497/982] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:35 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:35.180298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-033ce1dc-49d5-41b7-82d9-82604fade970 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 May 05 14:01:35.180849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 486/983] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:35.367440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:35.368435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:35.374347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.374802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.375564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:35.376764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:35.406375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-998e771e-e4f6-4940-974b-4f198fc4d2ed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042968 May 05 14:01:35.406884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 498/984] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:36.189323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:36.189943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:36.191301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:36.192226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:36.197038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.197492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.198318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.198756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.199418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.199870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.200630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.201070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.230038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-60b55b44-91ca-4c80-a44b-fbc1915abb21 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 May 05 14:01:36.230628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 499/985] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:36.258245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:36.266278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f83845ca-a185-4e5b-b346-b5ff29bd6d37 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080831 May 05 14:01:36.266833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 487/986] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:36 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:36.417175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:36.418148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:36.423973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.424420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.425185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:36.425617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:36.453061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fcf1c8a3-1b8a-4760-8724-c6c8a8dd1911 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 May 05 14:01:36.453589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 500/987] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:37.241142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:37.242000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:37.248299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.248747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.249517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.249956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.278990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c1163535-c144-401a-ab99-1ed22292bb44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041902 May 05 14:01:37.279553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 488/988] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:37.283306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:37.284067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:37.290737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.291183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.291954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.292746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.352999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:37.360252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-af476f46-923b-4016-a53a-52f474ac2950 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081025 May 05 14:01:37.360805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 501/989] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:37 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:37.465207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:37.466441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:37.472443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.472926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.473697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:37.474165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:37.502154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-100f874f-6c69-4d11-a41a-634dcf44623c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 May 05 14:01:37.502630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 489/990] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:38.291215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:38.292155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:38.298516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.298974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.299752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.300193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.327662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-17471a4c-bb86-45a4-af0b-5418a9080ced tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 May 05 14:01:38.328194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 502/991] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:38.376649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:38.377193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:38.383472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.383926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.384689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.385127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.447101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:38.454293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a9d8ce38-d86f-4420-92f1-bca3c84b83fe tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081545 May 05 14:01:38.454850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 490/992] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:38 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:38.513393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:38.514396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:38.520309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.520768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.521539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:38.521990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:38.550075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ea9cb1f1-07f9-4412-be55-c50da47311fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040662 May 05 14:01:38.550613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 503/993] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:39.339737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:39.340670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:39.346924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.347381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.348156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.348601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.376958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ca4ceb86-6807-400e-9433-77b2f5c0aa6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 May 05 14:01:39.380871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 491/994] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:39.471322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:39.471935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:39.478251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.478697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.479457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.479892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.538982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:39.546252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-420d1911-7556-4420-9bd0-fa26816c5aa1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078734 May 05 14:01:39.546802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 504/995] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:39 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:39.560995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:39.561923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:39.568136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.568577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.569329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:39.569757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:39.598205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0f1dc0cb-626f-4ff9-a91c-459a2b8f2868 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 May 05 14:01:39.598745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 492/996] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:40.388525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:40.389380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:40.395585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.402131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.402131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.402131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.426258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f15ef349-84a2-4b80-a785-b5b9c6a9b728 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041766 May 05 14:01:40.426791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 505/997] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:40.562693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:40.563314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:40.569749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.570246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.571020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.571463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.609280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:40.610263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:40.616541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.616983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.617748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:40.618313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:40.631912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:40.639458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41407ea7-b698-48b7-9170-3b2ddf795665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080563 May 05 14:01:40.640046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 493/998] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:40 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:40.646246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0ba936e-df2a-4c73-b535-44d8b7cdc641 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 May 05 14:01:40.646788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 506/999] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:41.437795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:41.438682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:41.444646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.445104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.445874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.446346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.474715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-776e2dd1-0f26-4c9f-91b1-0e859a1cb4c5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040977 May 05 14:01:41.475255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 494/1000] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:41.656753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:41.657368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:41.657857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:41.658821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:41.663958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.664415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.665065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.665229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.665523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.665676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.666314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:41.666756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:41.696994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ca104581-8f5c-463d-8b4f-0dcef1659183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 May 05 14:01:41.698389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 495/1001] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:41.727556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:41.735001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-97ab6ce0-0cd3-44cb-8023-7c35f7f66532 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082348 May 05 14:01:41.735557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 507/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:41 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:42.486276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:42.487116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:42.493102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.493554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.494969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.495407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.523091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-643dd6ac-9247-4da7-8f54-f6aa086b629a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040903 May 05 14:01:42.523631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 496/1003] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:42.708995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:42.709923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:42.717074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.717526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.718319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.718763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.746729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e5a433c4-6c69-46d3-b8c1-3745774cc61c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041634 May 05 14:01:42.747209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 508/1004] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:42.752072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:42.752695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:42.759195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.759647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.760411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:42.760848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:42.824137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:42.831804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e40df4fa-9877-43ce-b7d2-bfd9ed7432ef tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083533 May 05 14:01:42.832354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 497/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:42 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:01:43.534705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:43.535610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:43.542185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.542641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.543411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.543851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.571334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-35febc0c-1930-404b-a12a-0d6a43788b1f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040705 May 05 14:01:43.571866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 509/1006] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:43.758144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:43.759079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:43.765351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.765811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.766614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.767201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.795678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53b90d42-7930-4ca5-ba96-6d9a75774fc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 May 05 14:01:43.796175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 498/1007] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:43.847928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:43.848567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:43.854838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.855286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.856040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:43.856474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:43.915368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:43.922629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-06462f53-e6c4-46ef-85fd-b8fdd3f21a10 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078483 May 05 14:01:43.923174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 510/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:43 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:44.582866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:44.583935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:44.589919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.590399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:44.591409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.591851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:44.621955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a2fbc477-e180-410f-ac08-40b26037780d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 May 05 14:01:44.622555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 499/1009] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:44.807507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:44.808502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:44.814401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.814861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:44.815640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.816084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:44.843763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5ed3feab-d1b6-48dd-9496-fca385215fda tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040852 May 05 14:01:44.844243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 511/1010] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:44.939044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:44.939688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:44.945951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.946429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:44.947185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:44.947634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:45.011169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:45.020157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-356baa80-ca17-4b1d-a798-e593365ce320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084717 May 05 14:01:45.021021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 500/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:44 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:45.633967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:45.635543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:45.642114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:45.642578 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:45.643359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:45.643806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:45.673506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-091d7cfe-4853-4d91-8d52-cff1ad5c6acd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 May 05 14:01:45.674085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 512/1012] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:45.855152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:45.856084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:45.862060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:45.862517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:45.863278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:45.863717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:45.892117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-64c2f4a3-09f3-40f4-b241-7460ac6852a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040881 May 05 14:01:45.892603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 501/1013] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:46.042287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:46.042905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:46.048818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.049271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.050055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.050506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.110693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:46.118093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1b4d3072-5383-4553-9f98-59bf0f02fdf7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079765 May 05 14:01:46.118641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 513/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:46 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:46.684211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:46.685178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:46.691574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.692034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.692794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.693246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.721794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-96e2da5e-36fd-4d73-be66-4e0f807dabb4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041589 May 05 14:01:46.722371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 502/1015] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:46.904046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:46.904900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:46.911309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.911759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.912524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:46.912964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:46.940421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c251e13d-571a-4139-8c41-ae3156a8b67b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040931 May 05 14:01:46.940962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:47.136055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:47.136678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:47.142699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.143151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.143915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.144351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.206610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:47.214729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1876bf62-385b-44f6-9e2f-a12c535c8f97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083110 May 05 14:01:47.215289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 503/1017] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:47 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:47.733707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:47.734653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:47.740584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.741022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.741782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.742256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.770479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-54fec71e-5e43-422f-825a-89cd254cea7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 May 05 14:01:47.771038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 515/1018] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:47.953024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:47.953578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:47.959424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.959879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.960647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:47.961096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:47.992417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-01d89419-f901-4663-b748-bd2f99030183 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 May 05 14:01:47.993002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 504/1019] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:48.231612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:48.232227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:48.239230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:48.239674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:48.240441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:48.240877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:48.306843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:48.307827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bfd34877-1d17-4120-971b-bd2ff5316a9c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080072 May 05 14:01:48.308377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 516/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:48 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:48.781434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:48.782391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:48.788442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:48.788887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:48.789693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:48.790153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:48.819714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-144e89e4-b2af-481b-aa77-5f2eff758b6d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 May 05 14:01:48.820253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 505/1021] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:49.004025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:49.004905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:49.011365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.011818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.012573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.013005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.040747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5be0b4a-c066-4d1f-9c9d-dc7c2d252928 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040785 May 05 14:01:49.041279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:49.324637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:49.325258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:49.331596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.332045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.332807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.333250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.393878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:49.401323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f0550902-c006-44db-a5aa-efd3efdea06a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080587 May 05 14:01:49.401918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 506/1023] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:49 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:49.831408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:49.832330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:49.838794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.839245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.839999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:49.840433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:49.868392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69332fb2-5355-41f3-aafa-a8aea1d5ff7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041123 May 05 14:01:49.868923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 518/1024] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:50.052318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:50.053246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:50.059248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.059697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.060451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.060888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.091511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2063edd6-9fa1-4cf0-b6d4-ea2ef16a969d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042164 May 05 14:01:50.091511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 507/1025] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:50.418033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:50.418572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:50.424538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.424987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.425750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.426224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.485209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:50.492425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f4572ade-13ee-4f18-990e-6445feedb93b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078420 May 05 14:01:50.492978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 519/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:50 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:50.879072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:50.879995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:50.886430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.886876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.887631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:50.888063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:50.915667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1553da94-4466-4e22-98f3-37cfb0a23d08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040554 May 05 14:01:50.916213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 508/1027] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:51.103267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:51.103682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:51.110663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.111113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.111878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.112313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.139713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fd0507f9-bf34-46ce-8a59-671c6d2d74fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040973 May 05 14:01:51.140185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 520/1028] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:51.509565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:51.510134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:51.516625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.517072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.517981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.518450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.580204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:51.587578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d8778fa9-feea-42b9-9f67-d663d9244828 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081965 May 05 14:01:51.588134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 509/1029] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:51 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:51.927619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:51.928561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:51.935049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.935509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.936285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:51.936730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:51.967690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c6ca61df-760a-4067-8b2b-0ea5394a089f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 May 05 14:01:51.968240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 521/1030] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:52.150724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:52.151656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:52.158633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.159087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:52.159972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.160434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:52.190146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d989ac34-ec00-458f-a26e-e854a4ab6db4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 May 05 14:01:52.190630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 510/1031] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:01:52.605314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:52.605934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:52.615066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.615585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:52.616420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.617048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:52.676792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:52.684217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-65833f81-bf50-42b1-a3ca-8a6a8fb14a66 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083376 May 05 14:01:52.689393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 522/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:52 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:52.980143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:52.981071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:52.986975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.987428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:52.988183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:52.988621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:53.017234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2d4d181-536d-43a0-b3ce-4acfa3dda878 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 May 05 14:01:53.017785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 511/1033] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:53.202290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:53.203166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:53.209041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:53.209495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:53.210317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:53.210756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:53.237879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6bb96c4-17b8-4d89-a388-a39be10a7ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040313 May 05 14:01:53.238445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 523/1034] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:53.704241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:53.704847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:53.711357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:53.711812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:53.712570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:53.713002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:53.773429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:53.780919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-34aea460-ce12-4a31-ad37-5c02feb44afd tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080505 May 05 14:01:53.781480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 512/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:53 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:54.029297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:54.030217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:54.036526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.036979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.037748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.038222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.066184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-019321ee-5c78-4b64-875d-4a8c6f39fdf1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041439 May 05 14:01:54.066720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 524/1036] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:54.248758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:54.249676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:54.255607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.256066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.256818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.257252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.284810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0f2af3a3-0156-41cb-b856-7e4548a9d1d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039940 May 05 14:01:54.285278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 513/1037] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:54.797549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:54.798195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:54.804082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.804537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.805311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:54.805750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:54.864875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:54.872660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5874d064-2cdf-489e-b655-f44e9406c8c0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078957 May 05 14:01:54.873217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 525/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:54 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:55.084558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:55.085476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:55.092094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.092542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.093346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.093784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.123353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a04f141b-500d-4628-900d-90c38f9bdc98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 May 05 14:01:55.123835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 514/1039] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:55.295360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:55.296289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:55.302609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.303058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.303819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.304257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.332761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4b57ca3c-32ff-42f1-8506-32a817931f4e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 May 05 14:01:55.333348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 526/1040] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:55.889124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:55.889738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:55.895694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.896150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.896913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:55.897353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:55.961779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:55.969395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e5babbeb-d966-45c9-ab9c-a347d3e5a57d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084143 May 05 14:01:55.969958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 515/1041] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:55 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:56.134782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:56.135714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:56.141690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.142118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:56.142889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.143330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:56.171379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-62176a9b-db09-4eb6-b708-172b99d243d8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040584 May 05 14:01:56.171911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 527/1042] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:56.345731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:56.346678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:56.353075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.353530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:56.354388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.355494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:56.382919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-10fc553e-8f6e-4e12-bc38-b1f31c6781cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 May 05 14:01:56.383464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 516/1043] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:56.988064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:56.988625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:56.995026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.996044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:56.996799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:56.997231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:57.056678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:57.064467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ea84a53c-c0dd-4ea7-96c5-08b4275ba1f7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080362 May 05 14:01:57.065007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 528/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:56 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:57.182723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:57.184143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:57.190043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:57.190514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:57.191287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:57.191723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:57.220303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec0b1b63-a7bb-48aa-99bf-8b7f6ff2cb50 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041524 May 05 14:01:57.220853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 517/1045] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:57.394400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:57.395360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:57.401256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:57.401704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:57.402503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:57.402939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:57.430329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fb847340-d380-4ff3-b4b0-3a1c25d2a0a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039899 May 05 14:01:57.430860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 529/1046] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:58.081795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:58.082436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:58.088480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.088933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.089696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.090164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.150473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:58.158439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b2ea1ef-9867-4f6d-804f-d752bbc43109 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080459 May 05 14:01:58.158994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 518/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:58 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:58.231576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:58.232498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:58.239237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.239681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.240438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.240872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.269034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-97744ffd-f76b-4c19-baad-2c07fd7a2dbc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041314 May 05 14:01:58.269556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 530/1048] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:58.442039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:58.442896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:58.448809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.449258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.450033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:58.450482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:58.479082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6692d614-c7a3-4181-8e2c-1124f9843486 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 May 05 14:01:58.479627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 519/1049] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:59.175059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:59.175674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:59.181565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.182035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.182806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.183240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.242332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:01:59.250176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-03649d58-af08-43c9-b115-5c684482c5d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078956 May 05 14:01:59.250763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 531/1050] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:01:59 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:01:59.280173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:59.281128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:59.287496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.287946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.288712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.289148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.317247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bb856e19-a649-4ea3-b081-4577e39074c6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040969 May 05 14:01:59.317776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 520/1051] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:01:59.491387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:01:59.492219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:01:59.498142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.499251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.500007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:01:59.500441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:01:59.527714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-58dc6614-8a33-40ca-b50f-5eb0e5cdcfdd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040376 May 05 14:01:59.528248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 532/1052] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:01:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:00.267498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:00.268151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:00.274105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.274557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.275352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.275790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.329353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:00.330315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:00.336705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.337166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.337942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.338411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.338537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:00.346918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-811a3bc5-e552-41ca-a5c6-f6d71c5cc4fb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083832 May 05 14:02:00.347479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 521/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:00 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:00.367846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b215c451-5856-4972-9508-4a95982ea104 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042938 May 05 14:02:00.368329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 533/1054] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:00.539104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:00.540020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:00.545875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.546369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.547119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:00.547550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:00.575263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d0a51ee2-363b-4181-a72e-da67f7a5ebab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040069 May 05 14:02:00.575803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 522/1055] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:01.367349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:01.367888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:01.380242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.380242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.380541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:01.380987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.380987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.381171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:01.387753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.388210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.390106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.390819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.434710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-053f8553-27cb-4770-9563-3bbfc32aa619 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058352 May 05 14:02:01.435576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 523/1056] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:01.587553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:01.588490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:01.595437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.595888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.596660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:01.597097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:01.627792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6159f8fd-4af4-4ff7-a1a2-9b47adde70b7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 May 05 14:02:01.628253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 524/1057] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:01.684975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:01.692699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9bb6d919-187d-4d0f-bf86-f971f6235faa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.332453 May 05 14:02:01.693263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 534/1058] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:01 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:02.447258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:02.448113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:02.454517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.454969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.455763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.456200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.485147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-00a54909-8f66-4665-8ea1-a8d8861a354c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041958 May 05 14:02:02.485683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 525/1059] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:02.639730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:02.640669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:02.647090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.647547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.648319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.648764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.676516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e1ef6ec7-5b1c-41bb-b637-9765078b2d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041266 May 05 14:02:02.677058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 535/1060] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:02.709697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:02.710274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:02.716197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.716917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.718352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:02.718791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:02.778709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:02.786126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a6783f1b-c392-4fc1-92dc-2b3931f6f586 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080400 May 05 14:02:02.786690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 526/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:02 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:03.496703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:03.497565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:03.503576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.504032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.504803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.505244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.534198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e1226046-00d7-4bfc-a14e-63283d9f44a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 May 05 14:02:03.534739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 536/1062] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:03.687982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:03.688919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:03.695419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.695878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.696648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.697089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.727118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2cec343-1900-4b6b-aad7-97be11c703e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 May 05 14:02:03.729652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 527/1063] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:03.803250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:03.803803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:03.810189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.810642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.811407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:03.811847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:03.872290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:03.879447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0adb0828-1424-459b-a57a-179e0a05c2a1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080281 May 05 14:02:03.880001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 537/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:03 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:04.545128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:04.546005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:04.551947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.552397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.553157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.553595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.582933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0abe482c-ceb3-4ef8-9053-1aec5a81ed2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 May 05 14:02:04.583486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 528/1065] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:04.741565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:04.742532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:04.748499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.748948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.749703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.750175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.777670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cdd34c43-18c4-4e66-b3dc-5bc50f77e191 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040301 May 05 14:02:04.778231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 538/1066] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:04.896198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:04.896845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:04.903218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.903672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.904435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:04.905491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:04.964136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:04.972265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84fbfef2-38ec-42af-9764-e70c7ccb37c2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079971 May 05 14:02:04.972848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 529/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:04 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:05.594722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:05.595657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:05.602005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.602492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:05.603264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.603708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:05.632707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-45992c54-b00e-4d8e-9922-48cac95446fa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042279 May 05 14:02:05.633249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 539/1068] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:05.789722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:05.790646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:05.797077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.797530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:05.798314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.798756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:05.826576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-daadb206-ae3d-4ef6-8e25-bad2b6bcca48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040866 May 05 14:02:05.827132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 530/1069] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:05.989866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:05.990515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:05.996428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.996874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:05.997636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:05.998092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:06.060623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:06.068040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2c7f3c63-c150-4ce1-827e-8949f68a2eb1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082560 May 05 14:02:06.068596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 540/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:05 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:06.643859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:06.644791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:06.651300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:06.651745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:06.652504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:06.652941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:06.684144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-61c49bef-4a47-4ffd-bc77-ced4f574aae0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 May 05 14:02:06.685138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 531/1071] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:06.837308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:06.838263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:06.844861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:06.845320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:06.846114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:06.846554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:06.874235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dcf2ed72-3939-41aa-9a9d-d2f364949a51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040359 May 05 14:02:06.874704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 541/1072] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:07.084440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:07.085094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:07.091121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.091576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.093237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.093701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.153232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:07.161264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-07735a22-34ad-4e23-aacc-63d5c9ebc71d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080704 May 05 14:02:07.161825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 532/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:07 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:07.695982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:07.696940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:07.703505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.703971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.704735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.705178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.733997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-71b3fee4-b412-46bc-a40a-ccf6947d18d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041965 May 05 14:02:07.734591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 542/1074] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:07.885705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:07.886605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:07.893011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.893460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.894258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:07.894692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:07.922443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e1c8da5a-8025-4eee-b28e-1b10f62b3e18 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040832 May 05 14:02:07.922975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 533/1075] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:08.178093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:08.178649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:08.184969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.185417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.186245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.186684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.248120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:08.255489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a8b5432e-c8d9-4bcd-95b3-7ceafd71385d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081338 May 05 14:02:08.256036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 543/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:08.744809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:08.745743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:08.752175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.752702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.753394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.753833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.781939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a511a95-3fbd-4d92-a02f-e1c9dbb616b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041086 May 05 14:02:08.782526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 534/1077] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:08.933996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:08.934955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:08.940795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.941249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.942028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:08.942474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:08.970534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f07c6ce2-4fed-4037-be55-58770ea61c2f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040530 May 05 14:02:08.971068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 544/1078] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:09.272474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:09.273017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:09.279334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.279780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:09.280540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.280977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:09.340341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:09.347863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-87f2319b-5b26-4879-a716-a2bf9394abf4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079458 May 05 14:02:09.348415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 535/1079] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:09 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:09.793568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:09.794526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:09.801382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.801842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:09.802636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.803076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:09.831250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c7009d1c-9bed-427d-8329-ff9774e8c035 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041659 May 05 14:02:09.831782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 545/1080] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:09.981260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:09.982209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:09.990001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.990469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:09.991228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:09.991659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:10.021247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a7638ba-09ee-4591-8f76-1e42dfdf1e5f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 May 05 14:02:10.021795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 536/1081] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:10.364211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:10.364794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:10.370714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:10.371159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:10.371916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:10.372350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:10.435401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:10.439125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c4d33706-74c7-46c7-b540-5757942f3373 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078783 May 05 14:02:10.439680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 546/1082] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:10.843634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:10.844620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:10.850957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:10.851413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:10.852181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:10.852620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:10.880319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d0419eb8-014d-4d47-ad64-fa60fcd3b26e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041537 May 05 14:02:10.880854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 537/1083] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:11.033067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:11.034004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:11.040376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.040826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.041592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.042049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.069394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9da3475d-aea7-4246-952f-30f02ab24a34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040845 May 05 14:02:11.069933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 547/1084] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:11.456216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:11.456798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:11.462821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.463278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.464043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.464483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.529411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:11.537910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-99ad5989-65d8-4c12-8ed2-733e69ac9659 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.086128 May 05 14:02:11.538495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 538/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:11.892367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:11.893301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:11.899259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.899712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.900512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:11.900954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:11.929171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe6bc045-5e78-4bbc-8aab-f2310cc3cd2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041359 May 05 14:02:11.929706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 548/1086] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:12.081466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:12.082452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:12.088786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.089237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.090002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.090460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.118614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a5e501f-20e1-419a-bd34-373ee83c2b63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041740 May 05 14:02:12.119158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 539/1087] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:12.555521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:12.556274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:12.563259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.563703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.564470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.564906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.628873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:12.638234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a595fda0-dbc5-499c-944e-d61a5aac3d01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.087210 May 05 14:02:12.638793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 549/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:12.941504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:12.942460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:12.948402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.948855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.949710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:12.950183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:12.979647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4f4307f5-6c82-41d8-b8b6-61feac0582e3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042176 May 05 14:02:12.980200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 540/1089] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:13.227964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:13.228890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:13.235442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:13.235892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:13.236657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:13.237101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:13.265222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-50be203d-bd3e-4ce5-adeb-65afcb39284d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139031 May 05 14:02:13.265744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 550/1090] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:13.654786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:13.655435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:13.662331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:13.662778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:13.663534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:13.663966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:13.730737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:13.738261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-95b06bf3-6812-4a1f-a57e-94ada6dc76d9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.087282 May 05 14:02:13.738809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 541/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:13 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:13.991871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:13.992726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:13.999282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:13.999737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.000510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:14.000989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.031590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6a20ed5d-c17a-4a0c-ae80-1fc7bc0ffa41 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 May 05 14:02:14.032154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 551/1092] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:14.276774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:14.277624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:14.283586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:14.284028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.284781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:14.285212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.312109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e925c33c-e244-4800-951d-83948965663b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039392 May 05 14:02:14.313129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 542/1093] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:14.757709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:14.760782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:14.766822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:14.767317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.768091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:14.768533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:14.829257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:14.836583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-05d2e1a5-4cdc-42c7-a2dc-a73cd15dbb4c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083257 May 05 14:02:14.837144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 552/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:14 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:15.042986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:15.043900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:15.050840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.051292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.052056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.052495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.080463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1952a65d-b4b9-42b7-9808-a666439c747f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041521 May 05 14:02:15.081005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 543/1095] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:15.323856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:15.324689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:15.331609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.332065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.332835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.333275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.361711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-253a41e7-df35-4719-b49b-1da97d09013c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 May 05 14:02:15.362310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 553/1096] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:15.853852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:15.854489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:15.860366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.860809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.861569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:15.862000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:15.921662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:15.929414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ee855c3c-d04b-45db-bd3f-d102e7ccdc34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079472 May 05 14:02:15.929962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 544/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:16.092421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:16.093356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:16.099400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.099852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:16.100625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.101071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:16.130290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bdb23f48-8a8f-4985-8dca-63633caa3261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041900 May 05 14:02:16.130751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 554/1098] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:16.373774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:16.374729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:16.381075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.381459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:16.382247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.382683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:16.410580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8df8e667-e514-47d5-978a-1893a9090c51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040710 May 05 14:02:16.411124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 545/1099] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:16.946898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:16.947512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:16.954282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.954733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:16.955495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:16.955936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:17.016580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:17.024121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e51b481b-8ddc-4504-9280-c1806b500856 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081151 May 05 14:02:17.024672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 555/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:16 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:17.142332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:17.143264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:17.149239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:17.149698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:17.150507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:17.150955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:17.178842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6bd829f3-5a9a-48f2-9efd-5e0e8dc0cbef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 May 05 14:02:17.179391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 546/1101] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:17.422723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:17.423664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:17.429583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:17.430059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:17.430843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:17.431283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:17.465976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-27fe3644-3e1e-45e8-8eb0-bd1ade315d31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 May 05 14:02:17.467096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 556/1102] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:18.040673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:18.041332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:18.047680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.048131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.048898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.049369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.114886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:18.122325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4afe0bef-a19d-4b4c-b56e-2505724cf957 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085531 May 05 14:02:18.122883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 547/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:18.190933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:18.191875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:18.198196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.198653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.199425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.199868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.227851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4666d03f-886e-4a76-a651-443735dd2683 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041596 May 05 14:02:18.228389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 557/1104] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:18.480177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:18.481211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:18.487623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.488076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.488840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:18.489278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:18.517235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3529fa95-9c3d-4195-801e-c771da9fd14e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041143 May 05 14:02:18.517772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 548/1105] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:19.139507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:19.140128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:19.146080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.146534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.147299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.147737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.209593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:19.217217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e62bf966-68ab-41cc-b3f0-9c4d468143ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081328 May 05 14:02:19.217777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 558/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:19 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:19.239593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:19.240534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:19.246822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.247274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.248034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.248472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.277071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a91a137-3653-4f77-80bb-ed98ff3eac7b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 May 05 14:02:19.277604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 549/1107] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:19.527880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:19.528713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:19.535267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.535723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.536486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:19.536927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:19.564914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-63230acd-b1e3-4d59-907c-84810bb89e3f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041137 May 05 14:02:19.565449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 559/1108] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:20.234501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:20.235147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:20.241072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.241653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.242290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.242723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.288471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:20.289390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:20.295249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.295699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.296454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.296888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.303626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:20.310823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c91a88d-b0bc-432f-b12c-79c34a44a56d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080326 May 05 14:02:20.311384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 550/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:20 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:20.326180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-965236b7-3081-4836-99b4-671fe7a61dd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041577 May 05 14:02:20.326719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 560/1110] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:20.576386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:20.577314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:20.583331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.583785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.584546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:20.584984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:20.612795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-977dfc58-9140-4fa9-a28c-93930813d8b1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040441 May 05 14:02:20.613335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 551/1111] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:21.328676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:21.329295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:21.335698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.336145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.336907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.337338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.337960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:21.338918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:21.345889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.346375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.347144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.347581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.378379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7de273c1-279d-42ee-a056-fddfd749e792 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 May 05 14:02:21.379065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 552/1112] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:21.399545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:21.407839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dda62a60-974e-4842-b55c-facff042ba89 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083525 May 05 14:02:21.408387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 561/1113] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:21 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:21.624290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:21.626469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:21.631589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.631983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.632744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:21.633186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:21.661252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2a21bd13-4049-47d0-8103-f099af344334 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041056 May 05 14:02:21.661794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 553/1114] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:22.388797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:22.389652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:22.396300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.396752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.397516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.397956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.423938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:22.424665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:22.426965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f6642189-3e9d-40c4-bea5-98c7e4d77a96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 May 05 14:02:22.427526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 562/1115] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:22.431024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.431475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.432276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.432713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.492988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:22.500313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-20f38314-3aa1-4e49-827a-3faecc9fe564 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080749 May 05 14:02:22.500870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 554/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:22 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:22.671804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:22.673231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:22.679135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.679592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.680364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:22.680805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:22.708507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1470b7a8-0926-4af4-bc1b-11295ba4e188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040715 May 05 14:02:22.709048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 563/1117] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:23.439238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:23.440085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:23.446386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.446832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.447590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.448024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.475649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69ce0441-db38-455d-a36b-8978ea9de350 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041027 May 05 14:02:23.476185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 555/1118] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:23.516340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:23.516955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:23.523233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.523685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.524444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.524888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.587289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:23.594891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a616722a-8fc9-42d8-b4fc-c07d9855e761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082378 May 05 14:02:23.595456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 564/1119] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:23 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:23.721606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:23.722779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:23.728696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.729146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.729903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:23.730370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:23.760915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-206566b8-5a8f-495b-9fed-01bde13bbb51 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 May 05 14:02:23.761476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 556/1120] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:24.487535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:24.488387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:24.494387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.494842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.495610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.496052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.524608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cf42f0c4-30bd-411d-a301-6ce034c67f4f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041635 May 05 14:02:24.525195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 565/1121] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:24.612002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:24.612815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:24.619197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.619647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.620407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.620838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.681995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:24.689591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9d5f970d-3151-4c85-8236-6496f154ce99 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081985 May 05 14:02:24.690170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 557/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:24.772722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:24.773564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:24.779522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.779967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.780721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:24.781762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:24.810508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e381334-f0fd-41fb-a1c2-06c72d18d24f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041676 May 05 14:02:24.811403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 566/1123] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:25.535635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:25.536480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:25.542525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.542980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.543739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.544178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.572332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a3333d48-40f7-4d07-a3e4-5b6501502fd6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040730 May 05 14:02:25.572867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 558/1124] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:25.706141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:25.706757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:25.713082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.713526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.714306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.714741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.775954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:25.783529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-869d2b59-2e3d-40ba-bd57-e0422f935354 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081190 May 05 14:02:25.784091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 567/1125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:25.822318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:25.823213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:25.829464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.829914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.830707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:25.831151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:25.858627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7308e6b4-2ea4-4ddd-a06b-1ff6e762725a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040345 May 05 14:02:25.859175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 559/1126] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:26.584172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:26.585171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:26.591025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.591475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.592501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.592935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.621743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-199928b9-e1ec-4402-9b79-6c880eb9bbc4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041429 May 05 14:02:26.622213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 568/1127] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:26.800314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:26.800936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:26.806840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.807297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.808068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.808512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.868869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:26.869906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:26.871050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:26.877094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c511f12f-3162-4466-a991-215be9e1efbb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080726 May 05 14:02:26.877660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 560/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:26 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:26.877792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.878184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.879081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:26.879529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:26.907605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-70198d01-ddab-43a1-b38c-38e541c4eba8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 May 05 14:02:26.908147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 569/1129] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:27.633361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:27.634357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:27.640322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.640774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.641544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.641986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.670408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2edfdf29-2a85-43fb-8bf2-70a5d778e479 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 May 05 14:02:27.670960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 561/1130] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:27.893696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:27.894237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:27.900519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.901004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.901759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.902227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.919038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:27.920145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:27.926862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.927314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.928084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:27.928520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:27.957429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b4fcc4cf-6188-4ac2-9ebf-d1df48a8f9d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 May 05 14:02:27.958222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 562/1131] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:27.966278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:27.973997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-19f574e2-f915-4e00-90e6-b2a8fa15eba9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085007 May 05 14:02:27.974583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 570/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:27 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:28.682148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:28.683176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:28.689109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.689555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:28.690348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.690782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:28.719760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3df2ce3f-fe24-465b-b7d1-c9415bcdde14 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041623 May 05 14:02:28.720335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 563/1133] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:28.969370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:28.970366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:28.977175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.977624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:28.978421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.978856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:28.990651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:28.991263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:28.997008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.997456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:28.998266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:28.998701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:29.006917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-09315f1b-56f6-47c8-b83f-93d0dae73237 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 May 05 14:02:29.007471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 571/1134] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:29.058745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:29.066959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2826d9b9-1061-40ba-a3ca-2e5ac2840861 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080112 May 05 14:02:29.067514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 564/1135] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:28 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:29.731246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:29.732178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:29.738806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:29.739262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:29.740044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:29.740486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:29.768809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9247d670-fc94-4418-a901-13effa4c981a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 May 05 14:02:29.769347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 572/1136] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:30.018985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:30.020165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:30.026918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.027689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.028449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.028881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.059690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e6b23584-fafe-4928-9e00-a98156ad8563 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 May 05 14:02:30.060504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 565/1137] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:30.083414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:30.084035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:30.090324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.090777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.091544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.091989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.162096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:30.169862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e526e1c4-5216-4975-912f-c38425f94e64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.090278 May 05 14:02:30.170468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 573/1138] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:30.779491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:30.780417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:30.786405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.786853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.787611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:30.788046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:30.820295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b0f0330-2072-4e1b-a223-d3f0e2fd82e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044777 May 05 14:02:30.820850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 566/1139] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:31.071725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:31.072581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:31.078610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.079061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.079823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.080266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.108088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8187ec1f-a1ff-4bc7-81e1-9a6a5d2e3b47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040342 May 05 14:02:31.108655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 574/1140] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:31.190561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:31.191172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:31.197398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.197842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.198634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.199071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.258974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:31.266208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-68db17a6-bacf-4c28-8c72-236de623fa01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080134 May 05 14:02:31.266759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 567/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:31 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:31.831829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:31.832760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:31.838733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.839183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.839949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:31.840390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:31.868998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a05e4580-d2fa-4616-ba93-23fd702a4264 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041723 May 05 14:02:31.869545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 575/1142] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:32.120322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:32.121261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:32.129690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.130736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.131678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.133094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.161989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f28eaaef-8a49-4fca-b1f5-72dcdff46e6f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 May 05 14:02:32.162568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 568/1143] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:32.283125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:32.283736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:32.289982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.290456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.291211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.291645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.352656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:32.359822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92909c4f-07fd-48e0-93ab-eb0f577f9c46 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080477 May 05 14:02:32.360372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 576/1144] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:32 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:32.880962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:32.881819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:32.888165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.888623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.889395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:32.889838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:32.918694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2dff03e0-08e1-44f9-9774-f84c6a10f9e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042354 May 05 14:02:32.919241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 569/1145] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:33.172929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:33.174310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:33.180358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.180805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.181573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.182008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.214120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d6873996-4511-45fc-9d7f-36dfa6ff027f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 May 05 14:02:33.214668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 577/1146] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:33.376572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:33.377854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:33.384042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.384499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.385270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.385750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.449678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:33.457095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ffa49a7-ce83-4148-bea8-fc4d51a5b058 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084492 May 05 14:02:33.457657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 570/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:33 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:33.930222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:33.931160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:33.937404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.937858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.938665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:33.939111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:33.967484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7727c485-bb7e-4504-a5d8-bd9bab5d5d8a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040999 May 05 14:02:33.968020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 578/1148] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:34.226575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:34.227432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:34.233714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.234202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:34.234961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.235393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:34.263508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83f8a159-36a2-41ff-80f9-176969f6069c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040964 May 05 14:02:34.264048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 571/1149] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:34.473917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:34.474554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:34.480550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.480946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:34.481718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.482227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:34.542228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:34.549988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5212e055-b3a1-47cf-8b0b-74595b753490 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079890 May 05 14:02:34.550580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 579/1150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:34 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:34.978808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:34.979769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:34.985752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.987093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:34.988100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:34.988553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:35.016947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-314c01f3-0d42-43ae-844b-1b2263d6fbf5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042142 May 05 14:02:35.017481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 572/1151] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:35.274955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:35.275820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:35.282174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:35.282623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:35.283874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:35.284315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:35.312836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7f472b7a-bba4-4435-8bd2-562cb9d12448 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041856 May 05 14:02:35.313382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 580/1152] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:35.566663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:35.567202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:35.573449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:35.573896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:35.574687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:35.575123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:35.634939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:35.642313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc7543a3-3aeb-4d56-b0bf-c1ea154b34ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079609 May 05 14:02:35.642865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 573/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:35 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:36.028427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:36.029350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:36.035205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.035651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.036431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.037767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.069153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8e1f0a27-f545-4df3-bb0b-08758b0c94a2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 May 05 14:02:36.069902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 581/1154] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:36.324466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:36.325436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:36.331401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.331848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.332607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.333045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.360525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c29ad9c-c7f6-408b-af57-c41aa87aba8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040172 May 05 14:02:36.361072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 574/1155] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:36.659872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:36.660527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:36.666990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.667445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.668216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:36.668689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:36.728903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:36.736194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4e4f6405-755c-4e66-8477-5172b1d55414 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080749 May 05 14:02:36.736752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 582/1156] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:36 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:37.079945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:37.081447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:37.087852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.088300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.089058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.089494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.118477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56c38b4e-b0f8-4e25-ab76-6f50a15c14be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042462 May 05 14:02:37.119023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 575/1157] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:37.372760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:37.373695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:37.380464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.380923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.381696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.382178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.410590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0ae01a8-0d36-4690-8fd4-5e257f76b030 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041956 May 05 14:02:37.411139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 583/1158] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:37.753291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:37.753851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:37.759846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.760341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.761107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:37.761551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:37.824716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:37.832339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f25b1ba0-5d41-484f-b4af-368bce37a502 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083488 May 05 14:02:37.832937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 576/1159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:37 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:38.130431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:38.131364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:38.137684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.138209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.138974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.139411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.169231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bff5cb03-7acd-4d58-aff8-74352c7df49a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 May 05 14:02:38.170185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 584/1160] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:38.475043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:38.475895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:38.482250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.482706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.483470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.483907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.511290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f36c6a55-7b84-4e54-82bb-9a48e69d0b03 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040989 May 05 14:02:38.511827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 577/1161] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:38.849572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:38.850217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:38.856159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.856605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.857449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:38.857887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:38.917780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:38.925652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f7e39785-a1a0-45cb-a88b-1be309a536b8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080634 May 05 14:02:38.926332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 585/1162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:38 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:39.180883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:39.181833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:39.187947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.188400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:39.189167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.189604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:39.218039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f62d93df-9acd-4c8e-bbea-9d8566def20c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 May 05 14:02:39.218573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 578/1163] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:39.523265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:39.524110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:39.533557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.534022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:39.534812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.535257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:39.562854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2ef48281-0562-432c-bcf6-b0aac3448514 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 May 05 14:02:39.563404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 586/1164] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:39.942598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:39.943225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:39.949495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.949940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:39.950723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:39.951157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:40.012228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:40.019636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0a6deb71-3bee-4b04-81cf-f60a1647e29a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081399 May 05 14:02:40.020196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 579/1165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:39 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:40.229846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:40.230725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:40.236566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:40.237076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:40.238334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:40.239566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:40.268548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-99d47c48-2a66-4151-aad3-4702bb7c649b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 May 05 14:02:40.269147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 587/1166] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:40.574905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:40.575874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:40.581797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:40.582280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:40.583044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:40.583481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:40.611281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba04d365-2b53-4ace-b3e4-0d029df273bb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040402 May 05 14:02:40.611816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 580/1167] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:41.036547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:41.037197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:41.043465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.043911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.044665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.045094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.105321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:41.112766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ba4d5075-1a72-4c13-aaf7-7cc12f84ecb3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080213 May 05 14:02:41.113323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 588/1168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:41 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:41.280088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:41.281022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:41.287532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.287929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.288689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.289126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.317232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f3446f8d-2134-462b-b2cc-0400c5f7ae8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041126 May 05 14:02:41.317766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 581/1169] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:41.623350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:41.624283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:41.631076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.631526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.632315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:41.632749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:41.661161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-39a46019-fdd1-4a4f-bb7e-5b905a641abc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041796 May 05 14:02:41.661692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 589/1170] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:42.129436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:42.130064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:42.135940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.136383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.137131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.137563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.199935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:42.207225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf02089e-e6ed-4438-b8fc-6dcbf5782edf tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082478 May 05 14:02:42.207782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 582/1171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:42 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:42.328585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:42.329504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:42.335754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.336201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.336958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.337390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.365916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-93cf518e-f74f-46d8-8343-9c1b45cb7f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 May 05 14:02:42.366422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 590/1172] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:42.672617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:42.673551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:42.680448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.680897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.681658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:42.682145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:42.709668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-103a4e6e-78d7-4c04-85b9-6031b983a54f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041057 May 05 14:02:42.710234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 583/1173] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:43.224514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:43.225121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:43.231001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.231528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.232284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.232718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.291934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:43.299137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f463d537-21c5-4810-baf1-625d7d9e8717 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078975 May 05 14:02:43.300339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 591/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:43 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:43.377217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:43.378126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:43.384054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.384496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.385249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.385680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.413702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3171cac7-6ba3-4577-b79c-1ef55c75e415 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040554 May 05 14:02:43.414383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 584/1175] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:43.721112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:43.722562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:43.728829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.729276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.730061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:43.730503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:43.757731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b3ec8529-20c5-4354-b04f-2cef6de1f787 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040946 May 05 14:02:43.758296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 592/1176] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:44.315781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:44.316390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:44.322725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.323170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.323928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.324362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.383725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:44.391012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f0d055ab-5112-484a-8f93-a898832d31dc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079088 May 05 14:02:44.391573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 585/1177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:44 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:44.424409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:44.425326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:44.431159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.431605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.432359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.432790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.460894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4d8fdc64-60be-46a7-b1fc-65f41c3d5b48 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040403 May 05 14:02:44.461440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 593/1178] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:44.769524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:44.770502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:44.776288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.776745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.777513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:44.777952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:44.806085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3ea450a2-8be3-4ced-8436-f7f104c1ac11 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 May 05 14:02:44.806632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 586/1179] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:45.418168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:45.418168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:45.418168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.418168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.418989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.418989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.473286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:45.474268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:45.477816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:45.480794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.481256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.482049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.482505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.485519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-84d35527-3f61-4395-aba1-38d977aecb29 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081239 May 05 14:02:45.486095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 594/1180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:45 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:45.511654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b3f3cc1e-182d-4a8a-9f7d-92a1c64b8de6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 May 05 14:02:45.512207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 587/1181] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:45.817634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:45.818513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:45.824415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.824863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.825672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:45.826135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:45.853680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f8389736-0b56-46b7-ab23-0501a682d1c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040143 May 05 14:02:45.854239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 595/1182] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:46.503354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:46.503873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:46.510326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.510780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.511543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.511978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.523547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:46.524481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:46.530674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.531132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.531909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.532353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.562650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ea391cfb-1a39-4b00-892e-58c6329bd953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 May 05 14:02:46.563203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 596/1183] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:46.575535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:46.583630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec36761b-fbbb-4f52-9cad-927a80f89194 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084695 May 05 14:02:46.584185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 588/1184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:46 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:46.865605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:46.866566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:46.872504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.872969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.873741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:46.874218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:46.901655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f2d06374-188b-448b-a1bf-7c817a368480 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040583 May 05 14:02:46.902229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 597/1185] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:47.574923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:47.575876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:47.583192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.583640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.584423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.584867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.601549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:47.602234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:47.611340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.612015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.613196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.613857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.619048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2235ef7e-c1a4-4101-be00-03aa4cbb984e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048237 May 05 14:02:47.619620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 589/1186] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:47.686477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:47.693769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2f690e07-642b-4b8f-b764-5b708cab2037 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.096937 May 05 14:02:47.694349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 598/1187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:47 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:47.913278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:47.914166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:47.922288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.922766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.923551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:47.923988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:47.957791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-707ec81a-7b04-447c-a1cf-2d7c22e236ef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 May 05 14:02:47.958641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 590/1188] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:48.630123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:48.630985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:48.637257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.637709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:48.638509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.638955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:48.666932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bfe8330a-26a9-4396-8d4f-7dbbe0d57457 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040892 May 05 14:02:48.667477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 599/1189] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:48.709719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:48.710350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:48.716750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.717196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:48.718250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.718686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:48.780810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:48.788362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d92745c0-1ca9-41ac-b8c7-fe90fd0d8909 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082689 May 05 14:02:48.788914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 591/1190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:48 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:48.971611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:48.972450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:48.978428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.978883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:48.979650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:48.980091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:49.008405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5218bd33-4fff-4209-8393-d15f3734f6a5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041185 May 05 14:02:49.008949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 600/1191] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:49.679155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:49.680079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:49.685960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:49.686437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:49.687195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:49.687628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:49.716015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-870b0deb-af7f-4398-a1c3-57a40707070b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 May 05 14:02:49.716610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 592/1192] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:49.807626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:49.808239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:49.814189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:49.814643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:49.815442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:49.816399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:49.875893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:49.883925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fcb46477-0faa-4677-961b-b22e324f80e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080341 May 05 14:02:49.884489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 601/1193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:49 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:50.019871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:50.020719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:50.026669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.027113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.027864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.028296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.056483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f68beaaa-a4f2-4a4a-ba31-d56aefc78160 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040756 May 05 14:02:50.057014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 593/1194] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:50.728008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:50.728982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:50.734939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.735401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.736205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.736647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.765437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69e9d155-ca6c-4588-8619-aa4c5e13e5b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041366 May 05 14:02:50.765980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 602/1195] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:50.900688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:50.901231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:50.907510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.907961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.908709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:50.909142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:50.970966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:50.978311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0fee2862-e178-4a0f-a516-1c1d27a23ed0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081478 May 05 14:02:50.978861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 594/1196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:50 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:51.068626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:51.069559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:51.075848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:51.076299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:51.077070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:51.077511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:51.105476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9bc0a53f-d840-41fe-9547-9013d49a8ca7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041323 May 05 14:02:51.106149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 603/1197] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:51.776478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:51.777415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:51.783350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:51.783800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:51.784613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:51.785049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:51.813553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67836638-2d11-49d7-bfff-e7690cae3379 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 May 05 14:02:51.814105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 595/1198] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:51.995344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:51.995960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:52.001882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.002385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.003708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.004146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.061870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:52.069811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e8fed7d5-b6ac-4865-af29-67d1de659965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078324 May 05 14:02:52.070567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 604/1199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:51 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:52.116701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:52.117621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:52.123890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.124333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.125083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.125514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.153750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bcc887b5-96f6-40af-84dd-2f9ca2adf813 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 May 05 14:02:52.154327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 596/1200] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:52.825533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:52.826564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:52.832817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.833270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.834071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:52.834515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:52.862977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-526341b9-8e0f-4e4c-8644-9d99fd84e229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040897 May 05 14:02:52.863519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 605/1201] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:53.086498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:53.087114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:53.093338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.093791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.094591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.095030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.155545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:53.163309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46cbf85a-2528-4b7e-b5fc-bec8ff27589e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080686 May 05 14:02:53.163870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 597/1202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:53 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:53.165118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:53.166061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:53.171777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.172228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.172982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.173445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.201232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1159fe7f-adcd-498c-b008-1bcdd225aa2d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040014 May 05 14:02:53.201772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 606/1203] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:53.874661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:53.875588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:53.881510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.881967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.882751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:53.883187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:53.911510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-217b7885-6e8f-47af-adf2-1332560f82f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040824 May 05 14:02:53.912049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 598/1204] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:54.179745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:54.180285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:54.186595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.187105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.187959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.188398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.213377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:54.214392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:54.220736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.221180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.221940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.222451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.250590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-529c8d8f-e1ad-4150-a0bb-30b9264edbcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041102 May 05 14:02:54.251143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 599/1205] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:02:54.255307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:54.262782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c8a0bdcb-edc7-4fdf-95dc-e69a60388a39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.086954 May 05 14:02:54.263329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 607/1206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:54 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:54.923283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:54.924133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:54.930555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.930997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.931759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:54.932199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:54.960409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-28d5c272-720c-4c25-9a0a-88195f1f78aa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041243 May 05 14:02:54.968900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 600/1207] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:55.262115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:55.262965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:55.269245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.269687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:55.270476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.270911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:55.279153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:55.279779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:55.286577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.287029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:55.287802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.288243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:55.298953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e2afb1ab-e7d0-44c9-9738-561b6fe7b20d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040801 May 05 14:02:55.299506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 608/1208] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:55.351560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:55.358939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-14059b50-3995-48f2-b42c-2ef28039dc57 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083652 May 05 14:02:55.359497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 601/1209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:55 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:02:55.971713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:55.972646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:55.978765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.979501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:55.980309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:55.980759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:56.010114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0e57f576-488a-428e-a04a-94c2425fab5e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042607 May 05 14:02:56.010655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 609/1210] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:56.311166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:56.312045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:56.318929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:56.319379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:56.320141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:56.320576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:56.348638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d72f098-b50d-4e63-9ab2-62661dc83c0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 May 05 14:02:56.349169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 602/1211] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:56.376008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:56.376625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:56.383426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:56.383878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:56.384639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:56.385085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:56.445204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:56.452550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8864f4e8-dad0-4508-a955-015442cfffed tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080339 May 05 14:02:56.453107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 610/1212] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:56 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:57.022323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:57.023174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:57.029136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.029589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.030390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.030832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.058703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3f3b5ec6-5c5d-4a4f-9ede-34fabe7b2945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041058 May 05 14:02:57.059246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 603/1213] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:57.360386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:57.361296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:57.367772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.368230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.369002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.369445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.397245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-28ee91e6-14ab-4690-a188-41ea81c964f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040962 May 05 14:02:57.397855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 611/1214] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:57.469627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:57.470318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:57.476745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.477192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.477982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:57.478484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:57.538387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:57.545599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b2d08fe-9ef3-4106-a1dc-7de8c6a1273c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080068 May 05 14:02:57.546182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 604/1215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:57 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:58.070251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:58.071205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:58.077045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.077500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.078295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.078739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.108537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8d402bf8-5941-400c-bd89-ffb1856bc753 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042245 May 05 14:02:58.109080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 612/1216] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:58.409728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:58.410673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:58.416665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.417110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.417860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.418319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.446931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fc1a0029-7225-4eb6-9d75-cab73eb6a710 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 May 05 14:02:58.447461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 605/1217] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:58.561843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:58.562545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:58.568828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.569276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.570046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:58.570511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:58.629909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:58.637124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b83325e8-b51c-4c18-8f48-54f37aa7c84e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079137 May 05 14:02:58.637672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 613/1218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:58 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:02:59.120136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:59.121066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:59.126986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.127446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.128741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.129177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.157330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ce698a01-1eda-47da-887c-1a5c420f1c67 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041209 May 05 14:02:59.157863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 606/1219] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:59.458519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:59.459367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:59.465265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.465717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.466529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.466968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.494800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ac2cf5e7-9e8e-4bf0-933d-f5e0d085211a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040402 May 05 14:02:59.495343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 614/1220] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:02:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:02:59.652611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:02:59.653260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:02:59.659588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.660072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.660831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:02:59.661271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:02:59.723727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:02:59.731007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26064377-41d9-4922-808f-7a974f32f64b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082345 May 05 14:02:59.731567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 607/1221] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:02:59 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:00.168824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:00.169747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:00.176174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.176629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.177389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.177823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.205368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e157b83-a963-44cd-9fe9-c83ad2b5a915 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040498 May 05 14:03:00.205902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 615/1222] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:00.506996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:00.507832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:00.513860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.514333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.515116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.515548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.543285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a27df91d-d63b-4f79-a03d-a80ac4edb77c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041006 May 05 14:03:00.543816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 608/1223] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:00.748185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:00.748822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:00.754811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.755257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.756011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:00.756445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:00.817027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:00.824289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e266baa-f3e0-467c-a447-b0cf42c762eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080001 May 05 14:03:00.824878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 616/1224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:00 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:01.216839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:01.218040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:01.224907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.225352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.226124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.226568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.256359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-855a11fb-364d-4755-919b-886d17dd4eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043465 May 05 14:03:01.256911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 609/1225] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:01.555641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:01.556531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:01.562853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.563313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.564084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.564549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.591943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-415e074f-c561-4b8a-81f1-e4f8c6044eb1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041085 May 05 14:03:01.592492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 617/1226] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:01.840887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:01.841506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:01.847643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.848087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.848838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:01.849271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:01.908701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:01.916017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-690d9401-3135-48d0-a117-228c446a1af4 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078986 May 05 14:03:01.916580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 610/1227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:01 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:02.267432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:02.268388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:02.274348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.274804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:02.275572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.276046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:02.304376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-64b1b45c-0490-4f83-a570-d3582c9b8478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040903 May 05 14:03:02.304919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 618/1228] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:02.603928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:02.604864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:02.611253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.611707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:02.612468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.612906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:02.642264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a03240c5-fd89-4a1e-9df4-6173cc9a4cf6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042249 May 05 14:03:02.642817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 611/1229] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:02.933074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:02.933611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:02.939952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.940406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:02.941166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:02.941606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:03.007456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:03.014917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0634471-8224-4fc1-bbb2-8ca7a7a92cf3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085807 May 05 14:03:03.015509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 619/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:02 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:03.315472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:03.317223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:03.323358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:03.323805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:03.324561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:03.324997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:03.353563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c286923-4424-428c-8e12-103cc102cd91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 May 05 14:03:03.354135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 612/1231] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:03.654099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:03.655036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:03.661597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:03.662069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:03.662836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:03.663274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:03.693070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f9b7552-d6ec-45e6-9d2e-ae35c1175169 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 May 05 14:03:03.693615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 620/1232] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:04.032620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:04.033148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:04.039598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.040043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.040820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.041245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.107146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:04.114620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44bb3a3a-58b5-4a2a-a4ce-50997912d639 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085975 May 05 14:03:04.115171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 613/1233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:04 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:04.365039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:04.366636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:04.372944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.373389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.374181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.374617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.402654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-781b262b-3c26-43db-8215-283e342d0a9d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041525 May 05 14:03:04.403193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 621/1234] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:04.703889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:04.704836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:04.711362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.711819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.712593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:04.713032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:04.741675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-70ef453e-fa9c-4c1b-92f7-aa4b2841cc5d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041831 May 05 14:03:04.742254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 614/1235] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:05.131262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:05.131884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:05.137826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.138321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.139087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.139527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.198499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:05.205730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e3fc87e-8872-4c20-bfc7-7b1815045d47 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078317 May 05 14:03:05.206321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 622/1236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:05 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:05.414900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:05.415752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:05.422127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.422586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.423402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.423845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.456063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f5bb464d-46e0-41fa-ab08-4ecea24235c7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 May 05 14:03:05.456621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 615/1237] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:05.753030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:05.753887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:05.760868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.761320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.762180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:05.762622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:05.790267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4f232ca1-0ca0-4d06-afe8-4c819d971cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041340 May 05 14:03:05.790816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 623/1238] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:06.222657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:06.223268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:06.229331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.229777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.230559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.230994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.290344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:06.297902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9464ebc2-b217-4c93-a9a5-7c19f8121db0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079048 May 05 14:03:06.298514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 616/1239] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:06 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:06.468631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:06.469490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:06.475473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.475931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.476695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.477141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.506886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe37e951-ff22-4464-96f6-3ac4ea246206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 May 05 14:03:06.507432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 624/1240] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:06.801768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:06.802668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:06.809103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.809548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.810334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:06.810767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:06.838140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c6d5d51-4fd0-424f-80d6-3cf351c482d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040909 May 05 14:03:06.838681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 617/1241] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:07.314303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:07.314922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:07.321134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.321584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.322384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.322825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.383423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:07.390858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f3e5db83-17a1-4eca-b6a4-b810df6ad0ba tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080462 May 05 14:03:07.391413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 625/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:07 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:07.518582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:07.519565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:07.525460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.525902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.526688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.527124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.558516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-395f7160-47f5-426a-bd3c-b69337035a31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 May 05 14:03:07.560687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 618/1243] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:07.850204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:07.851144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:07.857101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.857547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.858345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:07.858783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:07.886645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-53684dc5-97ae-45a7-a9b8-d41c26c37a46 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 May 05 14:03:07.887181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 626/1244] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:08.407085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:08.407619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:08.414211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.414662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.415460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.415899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.477806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:08.485130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44d98258-6132-4d7d-af2a-27e6a7afe680 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081936 May 05 14:03:08.485677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 619/1245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:08.571120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:08.572047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:08.578377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.578830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.579587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.580024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.607820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ef37e079-d8b0-4617-8e45-3e001b56a3ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041240 May 05 14:03:08.608362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 627/1246] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:08.898045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:08.899026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:08.904972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.905421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.906218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:08.906660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:08.934872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-caa983d6-03e7-4776-9ed8-4d401ead7307 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 May 05 14:03:08.935414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 620/1247] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:09.502646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:09.503265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:09.509860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.510352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.511120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.511600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.572247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:09.580238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-71a3e54e-f87c-42d8-b20c-b9d69af34946 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081410 May 05 14:03:09.580801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 628/1248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:09 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:09.619186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:09.620227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:09.627416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.627931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.628759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.629759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.659425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4383ff28-a00c-453a-970b-e63fe8b7a945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 May 05 14:03:09.659984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 621/1249] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:09.947092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:09.948026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:09.953897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.954382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.955148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:09.955588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:09.983179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67f933c7-fccc-49d0-abae-e7c73a3e2833 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040042 May 05 14:03:09.983716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 629/1250] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:10.598180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:10.598796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:10.604725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:10.605172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:10.605924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:10.606385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:10.666824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:10.670623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:10.671548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:10.674332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-87ca6137-5dc9-4336-a3c4-e169139545f6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080411 May 05 14:03:10.674900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 622/1251] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:10.678171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:10.678624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:10.679387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:10.679823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:10.708175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8728305b-4590-4aac-949b-250c9030453a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 May 05 14:03:10.708726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 630/1252] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:10.994830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:10.995693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:11.001654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.002152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.002914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.003352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.031671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67b2d057-1c8a-4a51-bdce-d42ed1bc83ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040933 May 05 14:03:11.032238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 623/1253] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:11.690991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:11.692191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:11.698579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.699024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.699783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.700220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.720027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:11.720995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:11.727304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.727754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.728521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:11.728961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:11.759453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-59cab591-f060-4dbf-ab41-bb82c719cd39 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 May 05 14:03:11.759755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 624/1254] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:11.761428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:11.769233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-133ef65e-bf23-410b-88ba-08ddd3699f1e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082113 May 05 14:03:11.769776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 631/1255] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:12.042916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:12.043847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:12.049705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.050184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.051586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.052025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.080449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84ce19bf-7a4e-4930-8be9-836a64d0b74a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041421 May 05 14:03:12.080990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 625/1256] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:12.771063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:12.772019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:12.778400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.778862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.779677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.780087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.785248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:12.786854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:12.792482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.793059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.793841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:12.794302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:12.809008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7abecd91-37ce-4250-b575-9ed42ee7b701 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 May 05 14:03:12.811030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 632/1257] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:12.864503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:12.872188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2d3f2f11-be35-43b5-96ac-a02c44e036f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.091132 May 05 14:03:12.874267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 626/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:13.091239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:13.092171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:13.098516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.098966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.099738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.100177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.128120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da5c5860-0f32-4f9e-bf8a-b5303c707462 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 May 05 14:03:13.128673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 633/1259] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:13.820675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:13.821631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:13.828065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.828535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.829319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.829751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.858381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-09423c9a-1939-42a4-bf48-6a002de0fa52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041634 May 05 14:03:13.858911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 627/1260] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:13.889229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:13.889854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:13.896648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.897097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.897864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:13.898328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:13.957497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:13.964789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-30f26668-bf4b-4148-97ee-5602bb4e02e3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079375 May 05 14:03:13.965354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 634/1261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:13 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:14.140051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:14.140980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:14.147723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.148170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.148926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.149359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.177012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53c6b630-26a3-40e5-84f0-15d6e3b81484 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040894 May 05 14:03:14.177542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 628/1262] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:14.871119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:14.872051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:14.881156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.881960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.883354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.884116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.917557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fed900b5-842e-4e61-af9e-43f027549c5a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050342 May 05 14:03:14.918309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 635/1263] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:14.982340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:14.982857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:14.990132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.990644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.991427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:14.991868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:14.998477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:14.998980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:15.005061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.005524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.006319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.006751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.055780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:15.063296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a3aeccb-9824-493d-ac9d-ae7cf51df2c8 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084919 May 05 14:03:15.063855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 629/1264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:14 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:15.187614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:15.188477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:15.194663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.195109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.195871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.196305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.225210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cd323192-121c-4090-9b2b-e455c202ada7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041535 May 05 14:03:15.225768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 630/1265] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:15.929410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:15.930358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:15.936216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.936667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.937419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:15.937858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:15.965881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b4d85fc-8464-4d24-adfa-be15521ccc07 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 May 05 14:03:15.966449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 631/1266] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:16.080337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:16.080952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:16.087111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.087558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:16.088311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.088746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:16.154446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:16.161809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-267a73cd-4e4a-4b75-9404-df1864ca70af tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085075 May 05 14:03:16.162405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 632/1267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:16 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:16.236704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:16.237557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:16.244037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.244504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:16.245270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.245709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:16.273360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-729eba75-194d-4c22-a574-7ddacc6225d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040615 May 05 14:03:16.273892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 633/1268] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:16.978343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:16.979227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:16.985328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.985783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:16.986583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:16.987035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:17.017129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a1320b6-2cdb-4b76-9771-0a030a291c59 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 May 05 14:03:17.017675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 634/1269] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:17.177790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:17.178434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:17.184851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:17.185302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:17.186094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:17.186521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:17.249368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:17.257635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-42dcc435-4e45-49b2-8f12-dc3d0152d94a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083666 May 05 14:03:17.258229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 635/1270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:17 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:17.284316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:17.285242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:17.290936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:17.291429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:17.292180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:17.292609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:17.320955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-adc0c583-ca80-4d80-8dc2-de00cea7632d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040261 May 05 14:03:17.322626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 636/1271] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:18.029474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:18.030433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:18.036909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.037367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.038163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.038612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.067167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b29a8255-429c-4512-a4d1-c7056b57b279 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041713 May 05 14:03:18.067713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 637/1272] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:18.274391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:18.275017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:18.281413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.281839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.282633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.283076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.344673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:18.352101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e99ade09-f45f-4164-b0f0-5d6772726776 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081573 May 05 14:03:18.356890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 638/1273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:18.357108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:18.358053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:18.364016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.364472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.365240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:18.365681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:18.393645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-03c5cde7-2f71-4f0c-a58a-d3b3ab4254ea tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040016 May 05 14:03:18.394221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 639/1274] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:19.078660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:19.079579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:19.085914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.086389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.087143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.087574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.119544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-43f983e6-b785-4978-a2cf-cc4b13ed7355 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 May 05 14:03:19.120119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 640/1275] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:19.368649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:19.369290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:19.375420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.375865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.376625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.377059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.436910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:19.445202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-63ab901f-a866-423f-b8bd-97821a1c3ed3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080194 May 05 14:03:19.445746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 641/1276] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:19 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:19.453388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:19.453388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:19.465920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.466674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.467203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:19.467797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:19.496194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2a4d0983-55a8-4136-a20e-665c0525dce4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049424 May 05 14:03:19.496743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 642/1277] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:20.131648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:20.132573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:20.138463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.138914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.139666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.140101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.169411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-020b3faa-e591-4b2b-9955-448de399c74b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 May 05 14:03:20.169952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 643/1278] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:20.462160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:20.462796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:20.469259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.469704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.470485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.470919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.530497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:20.537774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30519907-df5a-43e8-8344-c1463d3572d5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079466 May 05 14:03:20.538351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 644/1279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:20 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:20.542754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:20.543653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:20.548982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.549422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.550201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:20.550667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:20.578607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-79566318-7ae5-4f8c-966b-d0fc17d84672 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039304 May 05 14:03:20.579137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 645/1280] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:21.180898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:21.181860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:21.187814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.188272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.189035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.189482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.217678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-19699b52-b7a7-4eb0-af40-89bfe1d9ba74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040768 May 05 14:03:21.218521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 646/1281] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:21.554470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:21.555285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:21.561592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.562072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.562829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.563258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.632674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:21.640169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e87cb0a1-428a-4807-9497-0436a8743c64 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.089736 May 05 14:03:21.640815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 647/1282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:21 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:21.645494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:21.646430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:21.654545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.654998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.655837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:21.656550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:21.687907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf93fb42-ae66-49e1-8296-b9340ea68d7a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 May 05 14:03:21.688457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 648/1283] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:22.230249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:22.231161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:22.240677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.241128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.242464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.242907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.271549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24cc5b35-3237-471d-acab-1666cc7b462a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 May 05 14:03:22.272773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 649/1284] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:22.656688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:22.657306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:22.664369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.665167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.665942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.666411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.725807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:22.733133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f720f8fc-851e-4340-bc51-239434e848a9 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080314 May 05 14:03:22.733685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 650/1285] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:22 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:22.738131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:22.739042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:22.745109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.745556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.746342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:22.746779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:22.774476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-da8b5fe3-5294-41a7-a729-e94c02a040d0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039779 May 05 14:03:22.775011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 651/1286] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:23.283794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:23.284715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:23.291157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.291607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.292359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.292793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.321907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1350e23c-9b11-48ed-98cc-22e17643b28c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 May 05 14:03:23.322474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 652/1287] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:23.749780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:23.750506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:23.757645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.758694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.758984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.759424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.820012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:23.827353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e8d4410-4d47-404d-9e70-2b1c38c3de87 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081459 May 05 14:03:23.827908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 653/1288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:23 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:23.832364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:23.833272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:23.839563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.840014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.840772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:23.841206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:23.868408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b3e0be88-820a-4ea0-9840-5c096a4859e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039532 May 05 14:03:23.868939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 654/1289] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:24.333569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:24.334524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:24.340479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.340910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.341671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.342140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.370667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dbe7f1ad-d14a-47a3-8755-a9f1a7cb51ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041064 May 05 14:03:24.371143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 655/1290] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:24.844871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:24.845514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:24.852544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.852999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.853764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.854248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.914988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:24.922445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c509233-cb48-48f8-8fb1-bbc96dd269cc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081766 May 05 14:03:24.922997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 656/1291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:24.927402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:24.928301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:24.933992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.934459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.935207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:24.935639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:24.963178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ef388aa-031a-45ae-9138-cef1ac7db553 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039231 May 05 14:03:24.963704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 657/1292] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:25.381302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:25.382837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:25.388721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:25.389168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:25.389914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:25.390372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:25.418580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67ff1e29-3222-4c4c-8c57-75b8835fc0d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041198 May 05 14:03:25.419112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 658/1293] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:25.939084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:25.939728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:25.946523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:25.946969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:25.947724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:25.948158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:26.010749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:26.018127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2bea405c-81cb-4fe7-a83c-f6741e622d95 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082929 May 05 14:03:26.018691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 659/1294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:03:26.023924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:26.024832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:26.030392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:26.030850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:26.031610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:26.032052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:26.059130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-929f87ab-b24a-4696-b3f8-26217a0b98e3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039485 May 05 14:03:26.059674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 660/1295] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:26.430370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:26.431331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:26.437232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:26.437682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:26.438477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:26.438919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:26.468727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e8ce29d-6578-4ffe-b07a-1c03a8559a93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042569 May 05 14:03:26.469273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 661/1296] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:27.035475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:27.036146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:27.042433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.042873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.043673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.044107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.104939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:27.112319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-951eba49-59f2-47ad-9295-263816a152fc tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080714 May 05 14:03:27.112869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 662/1297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:27 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:27.117859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:27.118793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:27.124568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.125014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.125766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.126227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.153068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-789d52e1-8cc1-4b2b-99ab-6abaca27db83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039262 May 05 14:03:27.153602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 663/1298] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:27.480988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:27.481907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:27.487835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.488283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.489047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:27.489483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:27.516817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2ec6cc3f-d08f-4107-99cd-ea5752ee0397 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040509 May 05 14:03:27.517349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 664/1299] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:28.129757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:28.130469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:28.137080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.137532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.138333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.138770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.201802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:28.210418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c942b464-b01a-4f03-8341-3e70308b5025 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084445 May 05 14:03:28.211254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 665/1300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:28 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:28.215933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:28.216881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:28.222956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.223413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.224186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.224634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.254275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c7e1e59-0150-4b19-a9aa-355f69aa1b96 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041775 May 05 14:03:28.254710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 666/1301] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:28.529081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:28.530041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:28.535916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.536381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.537160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:28.537605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:28.566546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bff754ba-daed-4a34-b1db-e1f182a14f55 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041523 May 05 14:03:28.567302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 667/1302] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:29.228268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:29.228925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:29.235309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.235761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.236525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.236967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.296641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:29.303940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a25fe28e-0445-4b54-9c4f-a80019d7b619 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080077 May 05 14:03:29.305131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 668/1303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:29 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:29.309664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:29.310607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:29.316186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.316638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.317403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.317847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.345863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2ef90288-de18-4f79-a348-5053965e6ab6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039758 May 05 14:03:29.346446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 669/1304] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:29.578766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:29.579698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:29.586258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.586721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.587484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:29.587925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:29.616505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3e065373-6d07-471e-9fcf-9667f31f8a84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 May 05 14:03:29.617054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 670/1305] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:30.321072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:30.321706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:30.329553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.330000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.330792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.331224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.394973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:30.402518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bbe04e92-e8d5-4806-b066-a20c5e7b0b1b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085929 May 05 14:03:30.403083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 671/1306] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:30.407509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:30.408416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:30.413789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.414283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.415042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.415474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.443204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b9b01c3a-6b06-4bd0-a4e5-f6a17ce61fab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039166 May 05 14:03:30.443743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 672/1307] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:30.627605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:30.628518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:30.634926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.635369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.636123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:30.636557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:30.665002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b8aba39f-cd56-499d-b8b8-7d5c06aec61d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041267 May 05 14:03:30.665536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 673/1308] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:31.419909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:31.420517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:31.426811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.427274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.428041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.428488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.488883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:31.497238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f55985b7-2ab2-40b8-aeac-367b454721f5 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081254 May 05 14:03:31.497798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 674/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:31 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:31.502386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:31.503334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:31.508802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.509254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.510042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.510486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.542380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2eacdf9e-85d3-42a8-8a33-af93d84c6e44 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 May 05 14:03:31.542942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 675/1310] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:31.676237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:31.677089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:31.682924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.683377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.684133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:31.684570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:31.712574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f7bb607d-4b84-45fe-b62d-63c79203d6b3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040229 May 05 14:03:31.713111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 676/1311] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:32.514766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:32.515388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:32.524731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.525262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.526108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.526561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.586870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:32.594382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41806c32-2c48-4ce3-a377-0264bba52570 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083631 May 05 14:03:32.594949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 677/1312] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:32 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:32.599412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:32.600345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:32.605748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.606241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.607011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.607456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.635987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-48e0b908-c5c7-4064-b921-6f2d8ed75b8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040058 May 05 14:03:32.636524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 678/1313] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:32.723912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:32.724831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:32.731223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.731685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.732448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:32.732891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:32.761190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ada0320a-a64c-4821-96b8-abc204ee2118 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 May 05 14:03:32.761737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 679/1314] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:33.610886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:33.611532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:33.617799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.618281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.619030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.619463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.679952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:33.687287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e568442e-5a7f-43d0-90ad-46c412bc1329 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080218 May 05 14:03:33.687844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 680/1315] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:33 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:33.692220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:33.693115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:33.698987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.699435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.700186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.700647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.728456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31812f21-24e8-4988-b3f6-f9326ff8c9b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039672 May 05 14:03:33.728979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 681/1316] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:33.771488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:33.772379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:33.778617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.779064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.779817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:33.780255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:33.808087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac77cfdb-0c39-490c-bb0b-2b35a474fa38 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040115 May 05 14:03:33.808612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 682/1317] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:03:34.704024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:34.704707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:34.711120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.712063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.712829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.713264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.775952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:34.783299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8992d46f-9538-4613-8910-66cadb58ab1a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083256 May 05 14:03:34.783856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 683/1318] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:34 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:34.788361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:34.789282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:34.795649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.796104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.796869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.797307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.825221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c48d152a-55c2-43df-9013-6390bf5b276f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040364 May 05 14:03:34.825776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 684/1319] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:34.830316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:34.831236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:34.838392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.838927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.853037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:34.853037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:34.879568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7dce2828-f069-4946-8304-e168c2e26282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052749 May 05 14:03:34.880118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 685/1320] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:35.800775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:35.801407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:35.808279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.808736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.809500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.809940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.870594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:35.878187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41ccc0aa-24c1-480f-ae75-07fd9991381b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081308 May 05 14:03:35.878752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 686/1321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:35 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:35.883499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:35.885184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:35.890248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.890702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.891462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.891975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.920095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ebcc5c0b-a4e5-48b0-b34d-3a66ac5364f7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040343 May 05 14:03:35.920682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 687/1322] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:35.925147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:35.926086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:35.932105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.934728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.934728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:35.934728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:35.961373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b04f7d2c-28bc-49f3-9895-e349b27024a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039731 May 05 14:03:35.961923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 688/1323] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:36.894961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:36.895652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:36.901982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:36.902405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:36.903162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:36.903595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:36.964618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:36.972386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a28e227d-3d85-492d-aa7b-90977c83c52e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081283 May 05 14:03:36.972945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 689/1324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:36 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:36.977411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:36.978341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:36.983877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:36.985338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:36.985338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:36.985541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:37.014318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5f1770b8-f7fa-4169-9a72-822ceec50732 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040346 May 05 14:03:37.014856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 690/1325] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:37.019223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:37.020090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:37.025476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:37.025926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:37.026711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:37.027141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:37.054186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-847d9e73-86b4-43aa-951e-1d611e4f9933 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038372 May 05 14:03:37.054727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 691/1326] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:37.989235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:37.989871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:37.996213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:37.996664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:37.997433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:37.997879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:38.058938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:38.066276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-90d7c7d0-63e9-47b8-8dba-0e255d89b86e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080997 May 05 14:03:38.066831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 692/1327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:37 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:38.071227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:38.072671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:38.078080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:38.078531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:38.079288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:38.079727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:38.108375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd2f07ee-2cf3-49ea-8e82-2f3b10e46841 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040550 May 05 14:03:38.108930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 693/1328] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:38.113337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:38.114266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:38.119613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:38.120064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:38.120825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:38.121258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:38.149017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-315c4d5b-1ddc-490c-a3b2-5d9cb2f53ea3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039140 May 05 14:03:38.149550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 694/1329] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:39.083253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:39.083897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:39.090138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.090585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.091374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.091806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.154606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:39.162278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-66cd0c19-a6fb-488b-b8a8-804b70e6db8c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082740 May 05 14:03:39.162858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 695/1330] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:39 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:39.167590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:39.170582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:39.174690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.176411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.177192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.177632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.208204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3f47e47b-d73f-4319-b279-9ce1828b7f00 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 May 05 14:03:39.208747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 696/1331] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:39.213119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:39.214057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:39.219686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.220136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.220891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:39.221328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:39.248881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d433ad3f-102d-44fc-bfe3-c0745cfb8ebe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039191 May 05 14:03:39.249406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 697/1332] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:40.180597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:40.181213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:40.188115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.188563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.189330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.189769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.251677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:40.259297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-10c14767-631a-45c0-96ba-09ddd5764d97 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082524 May 05 14:03:40.259859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 698/1333] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:40 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:40.264446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:40.265608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:40.271521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.271978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.272773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.273195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.302086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6125ace2-c35a-445d-8a13-f02ce4b9c8c5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041195 May 05 14:03:40.302647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 699/1334] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:40.307103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:40.308684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:40.314202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.314656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.315427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:40.315870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:40.344200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2ccd8a86-c54c-406a-a498-230a2921f031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040540 May 05 14:03:40.354810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 700/1335] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:41.276001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:41.276617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:41.283004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.283479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.284229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.284659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.344051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:41.351477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0c882854-3a7b-4451-920a-adf960654320 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079381 May 05 14:03:41.352024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 701/1336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:41 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:41.356475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:41.357330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:41.362786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.363233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.363980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.364414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.392557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b869e41f-635a-41a7-9245-a256c592e6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039587 May 05 14:03:41.393087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 702/1337] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:41.397354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:41.398258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:41.404041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.404484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.405230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:41.405663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:41.433052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3dcd71b6-d4c2-40f2-9280-79e324dac4ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039006 May 05 14:03:41.433585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 703/1338] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:42.368169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:42.368792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:42.375764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.376216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.376976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.377411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.437302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:42.444696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e50bfaaa-bae5-4479-b285-8e54e9ee7c69 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080500 May 05 14:03:42.445253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 704/1339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:42 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:42.449678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:42.450621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:42.456043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.456487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.457244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.457681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.485570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8885bead-c7eb-43bd-92f5-9a3c01966ab5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039356 May 05 14:03:42.486129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 705/1340] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:42.490584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:42.491472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:42.497500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.497951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.498732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:42.499171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:42.526784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-48554074-daa6-42c0-84de-d06fd5f96ab8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039725 May 05 14:03:42.527352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 706/1341] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:43.461306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:43.461944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:43.469049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.469495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.470277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.470711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.533663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:43.540937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4b436f6d-1561-4d87-9aca-c736ef7db7eb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083507 May 05 14:03:43.541486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 707/1342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:43 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:43.546577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:43.547478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:43.552968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.553417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.554205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.554642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.596564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b197b9c-c181-434e-ad59-48d535223eef tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054058 May 05 14:03:43.597141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 708/1343] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:43.603320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:43.604891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:43.613586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.614064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.614838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:43.615281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:43.643042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-110ca833-12d0-4026-a4e9-3e87067bbd84 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 May 05 14:03:43.643591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 709/1344] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:44.558785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:44.559422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:44.565648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.566134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.566889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.567348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.627569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:44.634887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75216523-d184-42fd-b650-88aa930c2c26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080628 May 05 14:03:44.635442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 710/1345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:44 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:44.639841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:44.640736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:44.646213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.646662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.647414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.647848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.677247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cb0ef198-42ca-4d96-99b8-d09d014453c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040792 May 05 14:03:44.677802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 711/1346] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:44.682212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:44.683224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:44.689337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.689798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.690587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:44.691023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:44.719101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d8daae5-5329-4596-af80-2affc71c2da0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040065 May 05 14:03:44.719643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 712/1347] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:45.651175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:45.651818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:45.658117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.658562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.659316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.659747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.719564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:45.726802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a438574f-39a9-4557-8508-c473a8c16644 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079487 May 05 14:03:45.727370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 713/1348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:45 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:45.732398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:45.733296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:45.738767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.739217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.739970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.740402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.767467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-18c03cff-9967-4e46-bbf3-0436b4cce8d5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039146 May 05 14:03:45.768005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 714/1349] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:45.772297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:45.773173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:45.778955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.779399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.780163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:45.780598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:45.808107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9ae42637-d687-4175-99de-e9a3e8bc088e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039173 May 05 14:03:45.808651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 715/1350] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:46.744120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:46.744742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:46.751045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.751497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.752262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.752703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.814954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:46.822361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-714ca4d8-a1fa-41b8-8830-b0b6900e5559 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082076 May 05 14:03:46.822920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 716/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:46 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:46.827529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:46.828469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:46.833940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.834421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.835181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.835619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.864436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-847a387e-c1f0-4069-b13c-c81c3cf340bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040491 May 05 14:03:46.865009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 717/1352] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:46.869369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:46.870321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:46.875666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.876115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.876870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:46.877309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:46.905780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fcc21639-ef47-4578-b74e-bc3c9c0c3967 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039780 May 05 14:03:46.906284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 718/1353] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:47.838961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:47.839646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:47.846253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.846701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:47.847453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.847885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:47.918113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:47.925566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d94ab110-e1f7-4f20-9f23-be07527cf43e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.090456 May 05 14:03:47.926145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 719/1354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:47 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:47.930589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:47.931503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:47.937786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.938270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:47.939051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.939493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:47.967754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-59f629db-2e45-4fc2-bffa-578f3ce36d5e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040636 May 05 14:03:47.968292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 720/1355] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:47.973193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:47.974110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:47.979564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.980017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:47.981352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:47.981792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:48.009320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d14a609a-7067-4c99-86ac-7f0a042cc193 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039635 May 05 14:03:48.009867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 721/1356] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:48.942955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:48.943664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:48.950849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:48.951305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:48.952076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:48.952566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:49.013146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:49.020548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7911a573-a1cd-46f8-b385-8f1a27f6d779 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081583 May 05 14:03:49.021107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 722/1357] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:48 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:49.025669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:49.026661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:49.032711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:49.033333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:49.034169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:49.034609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:49.063091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f25e837b-e1d4-4597-857d-3babb592eac8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041036 May 05 14:03:49.063632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 723/1358] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:49.067943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:49.068818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:49.074701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:49.075182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:49.075942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:49.076374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:49.104485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88baa488-85b1-4aa3-bfd5-692de04387ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039880 May 05 14:03:49.105575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 724/1359] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:50.037408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:50.038141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:50.044339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.044794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.045551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.045984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.107098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:50.114522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-096f5644-70a4-43fb-8dff-c80041d63b01 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080978 May 05 14:03:50.115079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 725/1360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:50 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:50.119501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:50.120405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:50.125845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.126318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.127070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.127500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.156524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53de5182-4127-48e1-8428-b94ba89058ac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040458 May 05 14:03:50.157078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 726/1361] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:50.161434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:50.162351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:50.167790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.168238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.168990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:50.169426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:50.196543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c886fb15-ea81-4c29-a4ff-9869468c9a43 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038533 May 05 14:03:50.197080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 727/1362] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:51.131000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:51.131614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:51.138516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.138965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.139719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.140151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.198749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:51.206652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-86b37671-b41a-4b61-a679-cc67929470ea tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079492 May 05 14:03:51.207206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 728/1363] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:51 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:51.211616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:51.212517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:51.218057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.218500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.219508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.219942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.247364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-424552c8-1bcb-4ac0-b324-38d6d0e06851 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039213 May 05 14:03:51.247898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 729/1364] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:51.252163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:51.253032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:51.258309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.258756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.259501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:51.259934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:51.287880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7398d749-8694-405f-8881-c68edeac20f6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039044 May 05 14:03:51.288416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 730/1365] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:52.223712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:52.224358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:52.230850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.231310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.232076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.232518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.295009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:52.302559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-92dfb38f-cb3b-497d-848a-add3ec674a7d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082686 May 05 14:03:52.303181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 731/1366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:52 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:52.308207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:52.311532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:52.318221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.318683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.319459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.319903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.349025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bcdf5ba3-3757-4d03-b0d5-3a519dcf80ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 May 05 14:03:52.349581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 732/1367] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:52.354223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:52.355101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:52.360501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.360956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.361719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:52.362196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:52.390207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1ffa9da8-a1e2-4768-8337-c0e4de1fe52a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039521 May 05 14:03:52.390906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 733/1368] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:53.319039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:53.319676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:53.326722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.327260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.328079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.328649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.390518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:53.397972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ca10a73b-27e8-4ba2-bad1-428b5ab59402 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082819 May 05 14:03:53.398559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 734/1369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:53 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:53.403150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:53.404068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:53.409483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.409932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.410860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.411298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.438810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-466393df-74e1-406d-a7d5-390e71f4389d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039301 May 05 14:03:53.439341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 735/1370] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:53.443781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:53.444658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:53.450456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.450912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.451661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:53.452100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:53.479650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38362df0-de7f-4b66-b626-582bb1e0ec8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039379 May 05 14:03:53.480464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 736/1371] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:54.416345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:54.416984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:54.424091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.424545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.425314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.425748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.488537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:54.496541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7da2634b-093e-4016-ac92-cc381fedf61a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083513 May 05 14:03:54.497095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 737/1372] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:54 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:54.501483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:54.502407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:54.507827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.508272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.509024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.509457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.536573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2e90cf83-1e27-4b72-ba19-be7dfc3ad8ad tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038532 May 05 14:03:54.537321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 738/1373] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:54.541619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:54.543043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:54.548400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.548849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.549592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:54.550032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:54.577781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed704136-68a5-4ef3-b915-41555d42f486 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039520 May 05 14:03:54.578556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 739/1374] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:55.513154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:55.513782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:55.520101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.520545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.521303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.521734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.581442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:55.588799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1dea72fa-8221-4729-a6f4-290f3af2f207 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079542 May 05 14:03:55.589851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 740/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:55 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:55.594526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:55.595430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:55.600763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.601210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.601966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.602427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.630214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2af24e04-6992-4067-ad90-0bda37ba6a47 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039345 May 05 14:03:55.630757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 741/1376] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:55.635046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:55.635980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:55.641351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.641796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.642620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:55.643053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:55.671236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44fd43ed-59b0-421d-a826-2ea55881b9f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039564 May 05 14:03:55.671772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 742/1377] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:56.606994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:56.607638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:56.614166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.614628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.615403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.615848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.679581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:56.686976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-baa518e1-6f5a-4bca-ab07-2dca5debf0fa tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084475 May 05 14:03:56.687531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 743/1378] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:56 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:56.691925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:56.692827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:56.698219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.699202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.699951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.700383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.728313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-413856bb-ae2e-4078-82ae-28b92948cbc0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039828 May 05 14:03:56.728853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 744/1379] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:56.733271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:56.734287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:56.739487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.739931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.740678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:56.741107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:56.768487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26ef58e8-8465-48d5-a83c-7e8de5d74bc6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038722 May 05 14:03:56.769018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 745/1380] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:57.703605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:57.704259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:57.710687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.711147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.711919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.712368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.772253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:57.780073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a4eabda-cd17-4dae-bc93-10a6cfc263e7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080281 May 05 14:03:57.780644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 746/1381] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:57 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:57.785078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:57.785993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:57.791445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.791904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.793307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.793755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.820877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-758c58f5-f786-4e08-8570-e7a4c3086550 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039278 May 05 14:03:57.821415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 747/1382] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:57.825761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:57.826670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:57.832011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.832464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.833227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:57.833673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:57.862358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6d837a9b-6087-45fa-a34c-2425532f74bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039983 May 05 14:03:57.862903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 748/1383] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:58.796736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:58.797406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:58.803379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.803825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.804578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.805010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.864731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:58.872682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-733ffd2b-94d0-4a7a-93bc-fc2ac41a2022 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079808 May 05 14:03:58.873232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 749/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:58 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:58.877663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:58.878592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:58.884107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.884551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.885306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.885738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.913312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a274a15-1bf3-426a-86ce-677acf7d538e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039073 May 05 14:03:58.913802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 750/1385] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:58.918588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:58.919472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:58.924714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.925159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.925908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:58.926367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:58.954108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a502c1b6-caad-4df9-a4b8-82a9e1bdf65f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039352 May 05 14:03:58.954639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 751/1386] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:03:59.889276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:59.889887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:59.896458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:59.896913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:59.897681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:59.898144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:59.957182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:03:59.965209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0026df70-83e4-40c5-90ad-0a47d7ef41d1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079865 May 05 14:03:59.965776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 752/1387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:03:59 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:03:59.970742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:03:59.971647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:03:59.977091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:59.977550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:03:59.978357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:03:59.978808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:00.007216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f51924c-cc29-4cb0-b167-aad6f04205f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040398 May 05 14:04:00.007759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 753/1388] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:03:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:00.012773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:00.013654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:00.019010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:00.019464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:00.020223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:00.020663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:00.047887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-715d3560-1001-4355-b801-c49b6767c965 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039130 May 05 14:04:00.048425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 754/1389] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:00.981490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:00.982140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:00.988389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:00.988843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:00.989614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:00.990178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:01.052286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:01.060566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30537846-185a-44aa-a503-bf9755dc60f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083067 May 05 14:04:01.061140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 755/1390] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:00 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:01.065670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:01.068036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:01.072385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:01.072834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:01.074306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:01.074759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:01.103387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c8530ee8-522a-4de2-97dd-344ca8995e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 May 05 14:04:01.103522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 756/1391] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:01.108469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:01.109374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:01.114858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:01.115308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:01.116067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:01.116510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:01.144383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1cea6c86-bc51-4f18-a090-8d8bcf10a4bf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039992 May 05 14:04:01.144918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 757/1392] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:02.077768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:02.078468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:02.084784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.085231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.085986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.086442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.394787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:02.402136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a979641-e65b-48d3-8f58-5f1de3a729bb tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.328668 May 05 14:04:02.402693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 758/1393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:02 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:04:02.407088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:02.407989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:02.413749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.414246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.415004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.415442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.443540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-35e8da68-7e66-4f0b-a4dd-336fcdbeceb7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039913 May 05 14:04:02.444075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 759/1394] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:02.448319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:02.449981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:02.455392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.455834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.456577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:02.457006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:02.492763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c70be038-4514-443b-895a-c5b8e90b7155 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047717 May 05 14:04:02.493317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 760/1395] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:03.418703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:03.419342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:03.425507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.425947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.426732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.427166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.486525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:03.493701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d86ade9d-6ee8-48f8-bbb5-b5ed97de235f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078893 May 05 14:04:03.494307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 761/1396] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:03 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:03.499211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:03.500229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:03.505938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.506423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.507187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.507626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.537249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-906e208e-0e65-4b18-a36f-cec6c7e4f06f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041992 May 05 14:04:03.537795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 762/1397] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:03.542328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:03.543221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:03.548583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.549037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.549792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:03.550265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:03.578086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d482f9e-0a89-4cac-b469-376ebe0ee031 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039294 May 05 14:04:03.578634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 763/1398] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:04.510496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:04.511206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:04.517454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.517904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.518699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.519138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.578582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:04.585970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-679b4b7d-bfaf-4bda-9819-ab42544deb36 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079409 May 05 14:04:04.586549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 764/1399] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:04 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:04.591629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:04.592613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:04.598417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.598880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.599629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.600065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.627787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d5543a46-88dd-4b63-b5dd-1be1da04075b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040287 May 05 14:04:04.628324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 765/1400] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:04.632789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:04.633668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:04.638975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.639422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.640173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:04.640614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:04.668960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a07e3941-7750-4c6d-9be7-5efce2333bdb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039671 May 05 14:04:04.669514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 766/1401] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:05.603512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:05.604171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:05.610862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.611307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.612060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.612491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.680736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:05.691415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1833d7c9-c407-4d52-a4b8-b3011b7e615a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.091880 May 05 14:04:05.691982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 767/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:05 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:05.696472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:05.697386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:05.703077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.703532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.704294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.704732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.733066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ae20316b-8396-45a7-97ab-b699d56c972b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040018 May 05 14:04:05.733530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 768/1403] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:05.738604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:05.739537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:05.745351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.749546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.749546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:05.749546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:05.777548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dcd5d82c-beb7-42f4-aaa9-eac9682895ed tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 May 05 14:04:05.778161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 769/1404] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:06.707668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:06.708290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:06.715237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.715688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.716453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.716891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.778973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:06.786308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c4e8ec8c-0edd-4d83-9afa-45f96b72408d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082497 May 05 14:04:06.786866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 770/1405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:06 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:06.791272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:06.792209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:06.798282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.798729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.799482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.799914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.828037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6cc98178-2de7-4878-8bad-ce314c9b6905 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040214 May 05 14:04:06.828578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 771/1406] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:06.832872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:06.833746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:06.839696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.840143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.840894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:06.841328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:06.870091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e2770c8-6474-4393-b162-802d0db66261 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 May 05 14:04:06.870663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 772/1407] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:07.803532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:07.804165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:07.811048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.811492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.812255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.812698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.873494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:07.881384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-095df9bb-9c0e-46c9-ad76-6aad15d281de tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081738 May 05 14:04:07.881949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 773/1408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:07 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:07.886585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:07.887499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:07.892966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.893422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.894353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.894800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.922372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3bc1e30e-bc9b-4293-b52a-12d848a7d81c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039356 May 05 14:04:07.922909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 774/1409] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:07.927392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:07.928273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:07.934233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.934687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.935449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:07.935889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:07.963291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c20114c-c4c9-43f4-bef5-de6d7184f3a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039396 May 05 14:04:07.963835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 775/1410] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:08.898154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:08.898807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:08.905172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:08.905627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:08.906427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:08.906866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:08.967477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:08.975233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fe4d9a06-04ee-425a-9e6b-89fed06b74ab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080980 May 05 14:04:08.975793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 776/1411] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:08.980827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:08.981734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:08.987198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:08.987645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:08.988405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:08.988841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:09.016064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1efde60b-c3f0-4e06-9ccc-f3bb94c3a010 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039318 May 05 14:04:09.016627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 777/1412] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:09.020903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:09.021779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:09.027605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:09.028051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:09.028801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:09.029240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:09.056792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c5d975f1-1891-4c19-93b8-f18d0a1a8a2b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039244 May 05 14:04:09.057458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 778/1413] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:09.992840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:09.993522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:09.999827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.000272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.001028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.001464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.060876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:10.068103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7996d2be-58d7-4887-b357-2a53a6c3f1c3 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079248 May 05 14:04:10.068658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 779/1414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:09 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:10.073087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:10.073987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:10.079430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.079876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.080640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.081076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.111188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc283fe6-9948-400f-a0d1-7a9bfc65285c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041538 May 05 14:04:10.111774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 780/1415] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:10.116127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:10.117016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:10.122368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.122817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.123569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:10.124003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:10.151675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b2fcf3b5-eb88-49d3-a246-6fa279cdc79b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038908 May 05 14:04:10.152712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 781/1416] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:11.084783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:11.085446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:11.091828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.092325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.093094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.093537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.153683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:11.161007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5421c4c3-42a4-42c3-b25d-cec618fae3e1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080074 May 05 14:04:11.161567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 782/1417] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:11 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:11.166072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:11.166987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:11.172984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.173435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.174235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.174672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.202507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-de140779-8247-4b95-a831-fd650a1e35da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039883 May 05 14:04:11.203064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 783/1418] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:11.207480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:11.208370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:11.213697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.214715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.215485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:11.215925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:11.243928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c6d891f-3f5f-4245-bae3-ffe02352a953 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039928 May 05 14:04:11.244470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 784/1419] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:12.178431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:12.179084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:12.186000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.186478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.187242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.187678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.250534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:12.257881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-20021cef-023b-40f6-a022-652d68b8a227 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083299 May 05 14:04:12.258467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 785/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:12 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:12.262969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:12.264548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:12.270148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.270595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.271349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.271781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.298625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-92096f7a-e849-441f-8c76-d6e0f726feae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039212 May 05 14:04:12.299164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 786/1421] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:12.303583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:12.304445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:12.310395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.310849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.311612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:12.312051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:12.339980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b0165df6-fbfc-49b6-9ee7-386ca16a88f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039845 May 05 14:04:12.340520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 787/1422] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:13.275121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:13.275793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:13.282126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.282582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.283347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.283787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.345588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:13.353265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa498fe5-8191-4de7-9b2a-cd65ea4ed665 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081917 May 05 14:04:13.353764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 788/1423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:13 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:13.358809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:13.359728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:13.366005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.366495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.367266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.367741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.398536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e00d85c-75f6-40e6-a869-e9e68bdd9ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 May 05 14:04:13.399094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 789/1424] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:13.404582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:13.405499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:13.411675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.412133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.412918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:13.413361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:13.444419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b31ccc3-25b1-4306-807b-5e1175a30d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 May 05 14:04:13.444985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 790/1425] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:14.374229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:14.374858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:14.381237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.381725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.382515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.382951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.461364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:04:14.469746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-33270a16-24d6-4856-97d7-735295fa7a30 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.099456 May 05 14:04:14.470348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 791/1426] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:04:14 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:04:14.474852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:14.475784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:14.482494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.482982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.483778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.484219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.514878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4acb0ad2-c4a2-41ca-b035-82f94b7ef6ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043050 May 05 14:04:14.515608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 792/1427] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:14.521555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:14.522173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:14.528653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.529103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.529869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:14.530347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:14.558938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bf544fdc-5d3b-4f4f-b1f8-2b684686ccf3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041352 May 05 14:04:14.559501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 793/1428] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:04:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:04:15.058723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:04:15.059153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:04:15.065031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:15.065485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:04:15.066295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:04:15.066801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.261581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: ERROR nova.volume.cinder [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Delete attachment failed for attachment 6cf43ee8-35f2-4c99-812d-ef3c0c9c7e22. Error: Volume attachment could not be found with filter: attachment_id = 6cf43ee8-35f2-4c99-812d-ef3c0c9c7e22. (HTTP 404) (Request-ID: req-98798027-ed70-4928-9555-0235ce1084c7) Code: 404: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6cf43ee8-35f2-4c99-812d-ef3c0c9c7e22. (HTTP 404) (Request-ID: req-98798027-ed70-4928-9555-0235ce1084c7) May 05 14:05:15.297439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: WARNING nova.compute.api [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Ignoring volume cleanup failure due to Volume attachment 6cf43ee8-35f2-4c99-812d-ef3c0c9c7e22 could not be found.: nova.exception.VolumeAttachmentNotFound: Volume attachment 6cf43ee8-35f2-4c99-812d-ef3c0c9c7e22 could not be found. May 05 14:05:15.438336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7cbaa4ba-b332-44d5-88fe-96db19b52ad8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 202 len: 0 microversion: 2.20 time: 120.443568 May 05 14:05:15.438962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 636/1429] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:03:14 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 0 bytes in 120445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 05 14:05:15.444612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:15.445252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:15.449597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1345698f-7e90-4d06-8cc6-4da384ee63bb tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 202 len: 0 microversion: 2.20 time: 60.395335 May 05 14:05:15.450206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 794/1430] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:04:15 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 0 bytes in 60397 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 05 14:05:15.451143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.451593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.452350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.452800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.455660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:15.456646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:15.463322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.463780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.464569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.465007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.494770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-976ac8ad-42e0-4fa6-aa0a-116a255ade1c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 May 05 14:05:15.496206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 795/1431] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:15.500736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:15.501660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:15.507585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.508045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.508802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.509234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.516366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:15.523686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6b6391b-6f15-4187-89d0-37b619f8e166 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083789 May 05 14:05:15.533665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 637/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:05:15.533665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:15.533665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:15.538113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.538627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:15.539337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7bfc3aac-8236-4828-87c8-71b48a2f60bb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 May 05 14:05:15.539545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:15.539916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 796/1433] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:15.540068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.506873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:16.507730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:16.514037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.514493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.515257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.515695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.543870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c8bc4689-c224-4311-8176-928cd9684e34 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041536 May 05 14:05:16.544414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 797/1434] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:16.549021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:16.549623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:16.555457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.555934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.556694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.557126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.629259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:16.636779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75f8888a-70b6-4616-831f-f15c45502994 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.091464 May 05 14:05:16.637344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 798/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:16 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:05:16.641741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:16.642738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:16.648672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.649119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.649872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:16.650327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:16.678843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ea8650ee-1031-469e-8665-571a97123ea1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040548 May 05 14:05:16.679387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 799/1436] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:17.555584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:17.556422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:17.562934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.563379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.564136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.564591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.592406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-86ed1b7f-61bb-4013-92c4-c3bb90417621 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040859 May 05 14:05:17.592954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 800/1437] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:17.653322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:17.653941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:17.659869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.660919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.661838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.662310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.721296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:17.729170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-390adc34-711d-4527-a79a-f2f98a05881d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079634 May 05 14:05:17.729739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 801/1438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:17 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:17.734196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:17.735123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:17.740577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.741029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.741799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:17.742279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:17.771363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d23b78fb-a406-4f38-88fc-9d5d9eafc55b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040627 May 05 14:05:17.771914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 802/1439] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:18.604824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:18.605752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:18.612176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.612626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.613437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.614439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.641797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d1adda5-361e-4821-a24b-3d55ebf38974 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041017 May 05 14:05:18.642379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 803/1440] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:18.745876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:18.746519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:18.752410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.752859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.753615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.754177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.813704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:18.820947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-788b3b11-6150-478e-80e2-59a1fa171dd7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078982 May 05 14:05:18.821503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 804/1441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:18 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:18.825900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:18.826831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:18.832463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.832919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.833693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:18.834197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:18.864431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa5d9562-cd05-46b6-bdb9-f8e634b7cde1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 May 05 14:05:18.864981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 805/1442] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:19.653474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:19.654427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:19.661343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.661792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.662589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.663027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.690590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46b199f4-6ef7-4195-87e1-91991ea4bed0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 May 05 14:05:19.691141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 806/1443] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:19.837628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:19.838312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:19.844336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.844790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.845832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.846316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.905570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:19.912915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-948bf029-fa80-4f1b-8a89-e061823f8b26 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079068 May 05 14:05:19.913483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 807/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:19 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:19.917993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:19.918930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:19.924576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.925058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.926410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:19.926847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:19.955371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f97b599-7fd9-4be2-87ca-6a21bbc09004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040703 May 05 14:05:19.955917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 808/1445] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:20.702236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:20.703223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:20.710110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:20.710562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:20.711322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:20.711755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:20.744819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7659cb7f-e8fa-4818-8505-c7ea75180e79 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 May 05 14:05:20.745375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 809/1446] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:20.929144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:20.929756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:20.935548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:20.935992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:20.936745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:20.937174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:20.998072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:21.005345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3cab2a75-634d-4771-9a1d-3481b98af42c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079772 May 05 14:05:21.005909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 810/1447] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:20 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:21.010336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:21.011247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:21.016591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:21.017043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:21.017808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:21.018270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:21.046323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-859a2252-6711-466e-bc4a-b3d07a3ec378 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039394 May 05 14:05:21.046866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 811/1448] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:21.756453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:21.757385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:21.763741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:21.764191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:21.764977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:21.765412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:21.793434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b12c0ed3-2d62-45e0-b30b-ad35a3e3682a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041043 May 05 14:05:21.793982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 812/1449] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:22.022462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:22.023000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:22.028918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.029363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.030152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.030593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.092874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:22.100638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1a864322-9453-456e-8752-e0886a82ecc7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082566 May 05 14:05:22.101687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 813/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:22 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:22.106241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:22.107159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:22.112973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.113456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.114324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.114767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.142345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a69b8b65-08b8-4028-80a7-7ace758b6f79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039653 May 05 14:05:22.142875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 814/1451] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:22.804601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:22.805562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:22.811920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.820105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.820105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:22.820105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:22.842199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9d14b47a-02d0-4a11-acab-34cfd2f9b7e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 May 05 14:05:22.842761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 815/1452] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:23.118074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:23.118696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:23.124692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.125145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.125906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.126386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.186582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:23.194743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-966eb7ec-b91e-4989-9909-c952176faf2d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081113 May 05 14:05:23.195344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 816/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:23 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:23.199867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:23.200790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:23.207086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.207546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.208335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.208784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.243950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b441ca9-605e-49b2-89f2-3680d8756bd5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047588 May 05 14:05:23.244528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 817/1454] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:23.854519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:23.855457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:23.861872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.862359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.863139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:23.864168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:23.894906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53ddd91f-4ba3-4edc-b04a-dad5c5b455a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044324 May 05 14:05:23.895461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 818/1455] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:24.212230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:24.212848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:24.218847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.219302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.220073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.220766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.280490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:24.287844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bd48f42a-f6ce-48ec-9628-b0c49c6e1ef7 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079426 May 05 14:05:24.288411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 819/1456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:24 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:24.293048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:24.293953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:24.299523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.299976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.301241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.301683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.330067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4329a3d1-745c-4ca1-8480-0378d87a41a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040596 May 05 14:05:24.330624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 820/1457] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:24.906620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:24.907572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:24.916188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.916642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.917432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:24.917870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:24.945483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ff1f6d7-2a81-4941-8c60-66db1bbe429d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 May 05 14:05:24.946052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 821/1458] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:25.304377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:25.304993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:25.311015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.311469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.312228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.312669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.371929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:25.379156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a5ac808a-d2ef-49b4-aacc-3c702cc0b546 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.078601 May 05 14:05:25.380259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 822/1459] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:25 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:25.384785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:25.385723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:25.391198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.391653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.392411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.392852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.421582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf9b619d-3087-44ad-8d3d-db689999641a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040366 May 05 14:05:25.422135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 823/1460] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:25.957080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:25.958575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:25.964947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.965396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.966210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:25.966650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:25.995074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2e7b57f5-bd56-437d-9039-6841e50298ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042123 May 05 14:05:25.995619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 824/1461] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:26.396076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:26.396719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:26.402742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:26.403194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:26.403958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:26.404396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:26.465673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:26.473363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-66aa684f-4877-45d6-8f05-2b85829a7006 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081059 May 05 14:05:26.473921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 825/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:26 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:26.478423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:26.479337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:26.484843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:26.485295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:26.486085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:26.486526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:26.515490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ced4919-7b49-490c-be79-518a31a834f3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040582 May 05 14:05:26.516039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 826/1463] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:27.005884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:27.006912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:27.013354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.013803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.014598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.015036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.043781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51b8affc-bc85-477c-85f7-19a448619a89 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042078 May 05 14:05:27.052277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 827/1464] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:27.490317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:27.490930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:27.497066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.497509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.498299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.498729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.558653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:27.565943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-805b7780-5976-4af5-98cb-b23afe63e34c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079921 May 05 14:05:27.566528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 828/1465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:27 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:27.571410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:27.572318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:27.577668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.578143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.578899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:27.579329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:27.608336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3ef0ca3d-0640-476f-ba51-c56954f8267b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040323 May 05 14:05:27.608888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 829/1466] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:28.055439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:28.056364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:28.062617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.063071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.063839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.064281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.092420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba217dbf-4ffe-4fae-ab25-7f2fb826fc2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040986 May 05 14:05:28.092988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 830/1467] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:28.583616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:28.584230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:28.590172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.590624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.591385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.591821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.656982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:28.664296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a35717a0-b86a-4e3c-9eb5-ace10b3cc047 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085106 May 05 14:05:28.664891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 831/1468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:28 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:28.669296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:28.670229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:28.675675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.676133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.677417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:28.677852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:28.706840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-058d3504-6bab-48e8-8b80-d40e2ffb2791 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040952 May 05 14:05:28.707424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 832/1469] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:29.104285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:29.105246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:29.111547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.111994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.112751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.113181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.142247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-90912788-106f-4722-813f-ea9a1e66168e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 May 05 14:05:29.143004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 833/1470] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:29.681131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:29.681745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:29.687696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.688144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.688899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.689330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.748942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:29.756401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1a9b2722-d5cc-4133-a570-89fe1fab6418 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079156 May 05 14:05:29.756960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 834/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:29 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:29.761353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:29.762312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:29.767809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.768253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.769008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:29.769441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:29.797590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9d4d2e5d-acec-4c7b-ae7b-10c77e5ae760 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039683 May 05 14:05:29.798151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 835/1472] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:30.154382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:30.155310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:30.162304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.162756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.163509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.163943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.192371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f78a895-0ccb-4594-83c0-ab587f62094c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 May 05 14:05:30.192921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 836/1473] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:30.773430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:30.774060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:30.780051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.780498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.781255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.781689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.844753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:30.853111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a70b3a51-01a5-4f25-8e71-90fcd585a8e0 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083528 May 05 14:05:30.853670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 837/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:30 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:05:30.858060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:30.858995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:30.864387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.864833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.865585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:30.866037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:30.894116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c363ec93-2406-48e2-b372-7b87348f35e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039438 May 05 14:05:30.894669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 838/1475] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:31.204075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:31.205000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:31.211639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.212085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.212847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.213280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.242904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5463d460-1756-4450-bdf3-f0b2f130b13f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042880 May 05 14:05:31.243464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 839/1476] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:31.870270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:31.870807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:31.876759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.877244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.878029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.878474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.937889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:31.945848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e141b06-d410-46ab-af0e-72cce8abf05e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079606 May 05 14:05:31.946438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 840/1477] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:31 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:31.950939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:31.951966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:31.957318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.957771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.958575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:31.959016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:31.987866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b4102f15-49f5-484d-83af-c1082476cf63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040464 May 05 14:05:31.988404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 841/1478] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:32.255029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:32.255890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:32.262241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:32.262699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:32.263469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:32.263909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:32.291942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba66574f-e263-4c90-b08c-402cc8c9b159 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041476 May 05 14:05:32.292487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 842/1479] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:32.961828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:32.962408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:32.968342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:32.968817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:32.969561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:32.970002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:33.029463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:33.037322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-246429e6-dddd-4fda-8a1b-86f86ce49cab tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079545 May 05 14:05:33.037887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 843/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:32 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:33.042393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:33.043305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:33.048894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:33.049343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:33.050157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:33.050593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:33.078831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38ad3b61-34bb-4c76-9e85-34786a985bea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039968 May 05 14:05:33.079366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 844/1481] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:33.303853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:33.304706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:33.311121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:33.311570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:33.312325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:33.312759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:33.340552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ddf4f4c-34fa-4021-9b26-1990ff7a3b91 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041163 May 05 14:05:33.341081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 845/1482] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:34.054720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:34.055333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:34.061219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.061668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.062455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.062894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.122905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:34.130820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e54a048a-f6d2-4808-906f-be4194e18f17 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080497 May 05 14:05:34.131386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 846/1483] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:34 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:34.135787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:34.136690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:34.142176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.142623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.143376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.143808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.171429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-035e0798-6d7e-4451-a35f-aab1d27cd73e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039088 May 05 14:05:34.171964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 847/1484] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:34.352533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:34.353446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:34.359626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.360075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.360826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:34.361260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:34.389094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b80c906-86a2-4d5c-8359-16fe2e774e1e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 May 05 14:05:34.389633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 848/1485] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:35.148160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:35.148783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:35.154841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.155299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.156072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.156515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.216049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:35.223730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f42ca1f-8375-4e8a-bd89-f859d24d7439 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080175 May 05 14:05:35.224295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 849/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:35 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:35.228718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:35.229628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:35.235032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.235489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.236255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.236697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.264643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a506185-bcde-4bd1-b42c-3dee67ab5d85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039377 May 05 14:05:35.265173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 850/1487] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:35.402814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:35.403769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:35.411877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.412335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.413114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:35.415634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:35.442692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c33e1ede-9a8d-427f-a5f1-3c7b75d02c49 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 May 05 14:05:35.443249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 851/1488] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:36.240415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:36.241024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:36.247203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.247680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.248438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.248871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.311652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:36.318923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-87f9904e-4a80-47ce-a026-486ec1d2d854 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082485 May 05 14:05:36.319479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 852/1489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:36 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:36.323943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:36.324843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:36.330243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.330690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.331443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.331876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.370453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e5280fd-f7e5-47a9-8d5b-3e439c34188a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049834 May 05 14:05:36.370928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 853/1490] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:36.453994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:36.454922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:36.461424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.461873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.462671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:36.463106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:36.491417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1ccf3c6f-33ee-47aa-82af-1a65f460311e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041047 May 05 14:05:36.491953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 854/1491] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:37.335527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:37.336140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:37.342004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.342476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.343232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.343664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.404336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:37.412256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-13b39a80-be1a-4032-85fd-c8e736fdecda tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080679 May 05 14:05:37.412811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 855/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:37 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:37.417228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:37.418158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:37.423544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.423989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.424744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.425174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.453209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5eee6f54-4e1a-47ac-8059-135fde29a13f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039431 May 05 14:05:37.453746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 856/1493] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:37.502518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:37.503443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:37.509581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.510033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.510916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:37.511364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:37.539409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bea10e03-9dec-49dc-a9b9-157a218808f8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040601 May 05 14:05:37.539968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 857/1494] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:38.429667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:38.430231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:38.436129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.436585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.437714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.438188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.497981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:38.506067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-855da50b-0df2-48ce-9df0-03c437be83a6 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080778 May 05 14:05:38.506630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 858/1495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:38 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:38.511141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:38.512056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:38.517941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.518426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.519191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.519633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.547536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e6c760d8-85b3-4a85-ae6f-0e478e64831c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039932 May 05 14:05:38.548084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 859/1496] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:38.553107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:38.553995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:38.559421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.559872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.560628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:38.561067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:38.589843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7491cfa9-0d99-46aa-9622-c8e892601675 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040707 May 05 14:05:38.590626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 860/1497] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:39.523664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:39.524300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:39.530559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.531006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.531764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.532197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.592102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:39.599729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-707bdbf3-a553-4a63-a28d-326324926342 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080600 May 05 14:05:39.600280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 861/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:39 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:39.604814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:39.605749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:39.611155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.611608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.612365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.612798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.640852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf5b879b-b374-4900-8330-1590df238b00 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039627 May 05 14:05:39.641390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 862/1499] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:39.645807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:39.647284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:39.652585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.653029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.653772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:39.654247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:39.681450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b5afefe-4395-4365-b03d-bef1aca38909 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039155 May 05 14:05:39.681975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 863/1500] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:40.616431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:40.617081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:40.623600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.624056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.624848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.625293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.692226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:40.699628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69bc2a67-dac9-45c9-8847-c38ed56c261e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.087178 May 05 14:05:40.700198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 864/1501] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:40 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:40.704707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:40.705659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:40.711764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.712322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.713002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.713468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.742492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc8220c0-b3f7-44ea-9052-cbe74530a478 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041310 May 05 14:05:40.743043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 865/1502] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:40.747554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:40.748453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:40.753896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.754401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.755166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:40.756167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:40.786611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4e616fe-364b-4dc8-ba1b-b93b0c58befc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042575 May 05 14:05:40.787207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 866/1503] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:41.716775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:41.717430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:41.724060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.724572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.725382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.725815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.788722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:41.796253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c4bc19c6-b6fd-42e5-88ef-d3bd09fe678f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083366 May 05 14:05:41.796814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 867/1504] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:41 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:41.801319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:41.802293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:41.807992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.808473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.809229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.809665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.838839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5337eb09-d69c-4dd6-9e4e-157dfce04998 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041038 May 05 14:05:41.839387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 868/1505] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:41.843741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:41.844636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:41.850337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.850732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.851486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:41.851919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:41.879148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bde50b3c-9baa-41bf-92e2-b3944917db7c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038819 May 05 14:05:41.879687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 869/1506] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:42.811900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:42.812532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:42.818853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.820537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.820537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.820537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.881632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:42.889048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc0e83e2-f7f2-4dd8-a94c-a217574e46f1 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081075 May 05 14:05:42.890874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 870/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:42 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:42.894036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:42.894950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:42.901222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.901672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.902483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.902923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.931348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-220b7e2f-371d-499a-8e72-3851053794cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 May 05 14:05:42.931903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 871/1508] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:42.936479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:42.937315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:42.942703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.943192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.943954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:42.944391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:42.973336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26830b48-fe27-4a13-9bd5-694b20184c2b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 May 05 14:05:42.974042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 872/1509] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:43.906789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:43.907457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:43.913696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:43.914179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:43.914942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:43.915376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:43.976110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:43.983470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83445a9c-4f3a-4e88-83db-84e4647ce34d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080645 May 05 14:05:43.984031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 873/1510] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:43 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:43.988464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:43.989403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:43.995469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:43.995921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:43.996681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:43.997120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:44.024758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6bbf1d24-26a3-47f5-99f6-fc4c0497f06e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039765 May 05 14:05:44.025303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 874/1511] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:44.029629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:44.030536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:44.036012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:44.036463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:44.037735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:44.038222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:44.065470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-caf0024e-6875-4119-aeda-c092404d2e54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039243 May 05 14:05:44.066009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 875/1512] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:45.001178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:45.001815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:45.008378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.008825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.009582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.010193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.071442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:45.078885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-96d95d58-6a9c-4136-b4ca-bfd970b22629 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082018 May 05 14:05:45.079469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 876/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:44 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:45.147456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:45.148422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:45.154315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.155010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.156037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.156516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.185683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e1480f67-f78f-4c69-b9cf-ce427bc8eaf8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105281 May 05 14:05:45.186265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 877/1514] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:45.190656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:45.191546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:45.196888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.197344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.198132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:45.198571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:45.227175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3cdb8e58-f170-4d22-ac6a-556502bc3cf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039954 May 05 14:05:45.227745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 878/1515] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:46.096303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:46.096983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:46.103426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.103876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.104635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.105068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.168206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:46.175462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-571cb2c9-dcaf-4801-94c8-7d9fc0e0eb5d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083346 May 05 14:05:46.176016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 879/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:46 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:46.196812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:46.197719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:46.203471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.203921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.204681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.205120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.233514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f621d299-cbb6-46e6-bdc0-183d5ded55e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040836 May 05 14:05:46.234145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 880/1517] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:05:46.238484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:46.239365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:46.245302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.245751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.246604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:46.247038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:46.274811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-64ed91f9-7d48-429e-88c4-f56174d21380 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039746 May 05 14:05:46.275340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 881/1518] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:47.192757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:47.193877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:47.200218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.200672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.201441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.201883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.262515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:47.269970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b9d3c395-2bea-4a35-93a3-f384cdc6f082 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081189 May 05 14:05:47.270564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 882/1519] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:47 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:47.275725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:47.276636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:47.282251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.288501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.288501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.288501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.312713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fe2b750f-4a60-462c-9dea-f43cb2c378c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041144 May 05 14:05:47.313279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 883/1520] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:47.317704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:47.319263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:47.324697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.325150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.325909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:47.326385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:47.353760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-62d55285-42ad-49c4-828c-e3c92f4fa2b9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039522 May 05 14:05:47.354398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 884/1521] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:48.287581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:48.288202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:48.294656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.295111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.295881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.296327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.356760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:48.364263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef830a92-b8b9-4f62-891b-1022dff33291 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081174 May 05 14:05:48.364854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 885/1522] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:48 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:48.369341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:48.370294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:48.375853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.381072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.381072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.381072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.406353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-343146a9-43cc-4149-a2e1-735d58ffda46 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040450 May 05 14:05:48.406914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 886/1523] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:48.411509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:48.415445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:48.418559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.419005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.419755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:48.420189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:48.447860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-be973141-faa8-44b5-b227-097359b21dbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040012 May 05 14:05:48.448395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 887/1524] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:49.381658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:49.382295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:49.388751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.389206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.389971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.390440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.450342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:49.457592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db8fcf67-8535-4bbd-93c9-6df495db7d70 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.079829 May 05 14:05:49.458186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 888/1525] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:49 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:49.462669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:49.463583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:49.469034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.469487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.470274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.470988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.501235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1d0971bb-3256-4521-a523-5dc8f2ab5c4d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042075 May 05 14:05:49.501779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 889/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:49.506190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:49.507070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:49.512415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.512863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.513614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:49.514075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:49.542770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a47ca76c-8167-412a-9349-69e14e55bbf3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040035 May 05 14:05:49.543311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 890/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:50.474324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:50.474962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:50.481361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.481805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.482598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.483028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.546401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:50.554382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b1fcddcd-e4a6-4bc2-b99d-25752f1c0288 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084281 May 05 14:05:50.554940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 891/1528] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:50 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:50.559340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:50.560237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:50.566044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.566539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.567314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.567754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.596829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a025d35d-cea1-409d-bc81-cf7ec524d388 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040887 May 05 14:05:50.597384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 892/1529] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:50.602048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:50.602956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:50.608491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.608939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.609700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:50.610162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:50.638481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38a8cb04-5f71-431f-8e18-da7323323ee1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040106 May 05 14:05:50.639027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 893/1530] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:51.571588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:51.572227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:51.578439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.578891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.579662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.580099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.644618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:51.652959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fbbbc73b-6666-4f36-a6c8-9b18c46d1ad2 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085804 May 05 14:05:51.653523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 894/1531] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:51 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:51.658339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:51.659315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:51.665083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.665535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.666339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.666778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.695149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4002c2b5-7915-4067-8deb-4febc73f1c79 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040649 May 05 14:05:51.695704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 895/1532] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:51.700112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:51.701010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:51.706569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.707022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.707783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:51.708220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:51.736237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d7c41d0-29d0-40db-b36e-893b9f4e22c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039571 May 05 14:05:51.736788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 896/1533] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:52.671932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:52.672579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:52.679444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.679898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.680665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.681107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.745839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:52.753267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f43165cc-a618-44d7-8691-467805d33a34 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.085254 May 05 14:05:52.753827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 897/1534] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:52 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:52.758871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:52.759788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:52.765511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.765965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.766773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.767219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.795738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51ddbb26-1ddd-4c60-b2a7-5c0cfb84d6a0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 May 05 14:05:52.796300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 898/1535] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:52.800955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:52.801872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:52.808035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.808483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.809245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:52.809684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:52.838894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5eb13a73-c44d-4186-ab31-6778e2e7a39e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041555 May 05 14:05:52.839460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 899/1536] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:53.770486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:53.771148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:53.777444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.777900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.778705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.779147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.839194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:53.847018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7e39d23d-e640-4829-94de-106ec446c6ee tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080501 May 05 14:05:53.847584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 900/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:53 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:53.852732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:53.853645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:53.859540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.859985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.860782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.861239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.889510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-63dd6672-6ad7-4f1e-9df7-87e548788a6f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040965 May 05 14:05:53.890067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 901/1538] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:53.894410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:53.895292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:53.900550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.900999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.901763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:53.902229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:53.929730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2245c830-f70e-409d-9cf2-d4492f87c61b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038731 May 05 14:05:53.930282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 902/1539] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:54.864161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:54.870357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:54.871515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:54.871961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:54.872715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:54.873178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:54.936821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:54.944942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6edac803-3371-47eb-b365-722fcb2ba99a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.084642 May 05 14:05:54.945510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 903/1540] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:54 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:54.950007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:54.950943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:54.956468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:54.956921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:54.957704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:54.958152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:54.986349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-149d027f-19f9-406b-9394-0e49009f4f11 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039730 May 05 14:05:54.986806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 904/1541] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:54.991753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:54.992649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:54.998169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:55.002172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:55.002172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:55.002172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:55.027783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a56cbd82-0e4a-46ea-9622-2b80b4622872 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040020 May 05 14:05:55.030058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 905/1542] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:55.962483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:55.963150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:55.969452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:55.969905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:55.970970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:55.971413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:56.032199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:56.040860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d52c995-f564-4275-bbc9-1e0f39e56433 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082803 May 05 14:05:56.041433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 906/1543] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:55 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:56.046062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:56.047008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:56.053780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:56.054273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:56.055172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:56.055713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:56.083981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fbacf780-b9ff-43b0-8a12-3defe59a6353 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 May 05 14:05:56.085057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 907/1544] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:56.089353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:56.090271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:56.095449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:56.096160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:56.096911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:56.097345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:56.126919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0b5a6f27-99c1-4c5d-bd14-a49ed3d10ee5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 May 05 14:05:56.127485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 908/1545] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:57.057390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:57.058077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:57.064275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.064761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.065529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.065969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.126869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:57.134457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-55a3e10d-9d8f-42cf-abf1-d5468986a744 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081612 May 05 14:05:57.135027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 909/1546] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:57 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:57.139566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:57.140486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:57.146142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.147131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.147905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.148358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.177317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41ed71c4-d66b-4f99-86df-7218e3d034e2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 May 05 14:05:57.177896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 910/1547] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:57.182823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:57.183735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:57.189434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.189998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.190970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:57.191417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:57.219892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e9e8a2b-e249-45b2-aaec-df49235c3b62 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040735 May 05 14:05:57.220445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 911/1548] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:58.151263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:58.151878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:58.157973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.158462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.159235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.159675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.219478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:58.228423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-abe9d7c1-2b45-40d5-93d9-2b34eb976c24 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081118 May 05 14:05:58.234065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 912/1549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:58 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:58.234687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:58.235606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:58.241814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.242299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.243067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.243511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.271416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f9e71992-65f9-400a-b160-f2d9a039d42d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 May 05 14:05:58.271965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 913/1550] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:58.276449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:58.277339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:58.282688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.283143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.283902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:58.284341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:58.312376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-653fb9fe-8eef-48e6-a62b-f8a25e90e47c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039487 May 05 14:05:58.312916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 914/1551] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:59.246182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:59.246815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:59.256016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.256469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.257244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.257720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.325670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:05:59.333194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5cedc7a8-c0f5-42fc-bd9c-c28b60c6220b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.091745 May 05 14:05:59.333762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 915/1552] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:05:59 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:05:59.338294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:59.339197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:59.344648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.345100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.346142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.346585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.374721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51074f61-ac99-4914-89e6-1e590287edab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039889 May 05 14:05:59.375198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 916/1553] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:05:59.379517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:05:59.380404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:05:59.386324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.386776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.387532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:05:59.387970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:05:59.415001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56a4f0d8-caca-4372-81c7-5def1ea95b66 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038882 May 05 14:05:59.415536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 917/1554] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:05:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:00.350169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:00.350805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:00.357784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.358216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.359016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.359455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.420675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:00.428084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ebba03de-dfdc-428a-bf08-dfcdaa1e1f23 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.082027 May 05 14:06:00.428648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 918/1555] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:00 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:00.433113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:00.434040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:00.439535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.439994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.440764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.441207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.470378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e740226-f2f7-4079-b9fa-ffcaeaf7926b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040726 May 05 14:06:00.471177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 919/1556] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:00.475591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:00.476485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:00.481966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.482451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.483211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:00.483660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:00.511318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d78013ed-0c09-4941-b5b3-20f9c3ee2eb5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039206 May 05 14:06:00.511865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 920/1557] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:01.444908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:01.445525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:01.451777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.452229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.452986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.453415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.513637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:01.521086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-715e8846-cd9c-4e85-96b2-11f46e78494d tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080246 May 05 14:06:01.521646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 921/1558] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:01 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:01.526617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:01.527520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:01.532890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.533335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.534119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.534557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.562505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-57d29b9f-1343-410c-ab26-cf093095760f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039833 May 05 14:06:01.563048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 922/1559] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:01.567366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:01.568241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:01.573655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.574140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.574927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:01.575361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:01.603619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-be21d1b3-3c1b-4ba0-b565-68a16080009e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039647 May 05 14:06:01.604161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 923/1560] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:02.538146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:02.538792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:02.545569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.546034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.546804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.547239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.607141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:02.614598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b24b9444-81ac-4947-9558-9f745c91437a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.080362 May 05 14:06:02.615157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 924/1561] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:02 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:02.619579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:02.620476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:02.625837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.626316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.627066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.627531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.655727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d484b993-dfe9-4cc2-b9e6-0b56bf167927 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039615 May 05 14:06:02.656273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 925/1562] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:02.660580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:02.661457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:02.666808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.667250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.667998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:02.668428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:02.696148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a4cd86cf-aca9-4459-a2e4-e268d7211596 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038427 May 05 14:06:02.696879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 926/1563] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:03.631149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:03.631798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:03.638108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.638565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.639334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.639773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.703701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:03.711221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4dd7cd85-c03c-4bea-8d21-244209e44531 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083947 May 05 14:06:03.711803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 927/1564] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:03 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:03.716357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:03.717266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:03.722985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.723439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.724205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.724644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.753433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-60611d27-9630-4952-bb6b-e19d57940315 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040613 May 05 14:06:03.753972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 928/1565] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:03.758477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:03.759357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:03.764649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.765098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.765853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:03.766324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:03.794082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-939d3a7e-0a7b-49f9-a70c-ed89e9632876 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039144 May 05 14:06:03.794622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 929/1566] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:04.728467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:04.729266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:04.739368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.739819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.740589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.741026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.801876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:04.813193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8652682b-b3b3-40f2-8ba5-8f536a06164a tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.089250 May 05 14:06:04.813760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 930/1567] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:04 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:04.818305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:04.819226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:04.825084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.825536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.826331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.826768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.855584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8b3dee96-b10b-4769-bf6b-5d4f41468f2d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040830 May 05 14:06:04.856131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 931/1568] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:04.860575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:04.861479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:04.867056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.867552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.868299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:04.868735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:04.897168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b49be89-8daf-41fa-8245-e7ac0cfcab87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040069 May 05 14:06:04.897749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 932/1569] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:05.830115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:05.830759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:05.837763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.838246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.839013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.839450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.900354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:05.907709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4b43d188-a19a-43a5-a39f-8b202c4a0e76 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.081602 May 05 14:06:05.908272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 933/1570] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:05 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:05.912736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:05.913641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:05.919119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.919570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.920336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.920772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.949194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2e659143-8f41-4be5-b313-757dff9a77cb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039964 May 05 14:06:05.949733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 934/1571] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:05.954061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:05.954940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:05.960205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.960654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.961460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:05.962425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:05.989659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b013804-4571-4d21-84f4-5c6889299070 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.038968 May 05 14:06:05.990222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 935/1572] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:06.924207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:06.924869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:06.931164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:06.931621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:06.932584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:06.933023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:06.995988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:07.003637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ea13f01-641c-494d-b07a-4df9d9839761 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.083301 May 05 14:06:07.004192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 936/1573] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:06 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:06:07.009259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:07.010240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:07.016571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:07.017263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:07.018111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:07.018556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:07.051128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-85806daa-b9c3-4241-81fc-4f5a46791991 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 May 05 14:06:07.051727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 937/1574] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:07.058729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:07.059674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:07.068426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:07.068881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:07.069666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:07.070131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:07.099244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05dc884b-124a-4ea5-a444-0b622e7f3993 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046492 May 05 14:06:07.099808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 938/1575] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:06:08.062392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:08.063229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:08.069560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.070005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.071350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.071788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.100928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c6964fa-532b-4c5d-a598-d7c6a83a5a80 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 May 05 14:06:08.101482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 939/1576] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:06:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:06:08.168380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:08.169002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:08.174966 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.175421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.176188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.176631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.240165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:06:08.248112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7b81da8a-f727-4e80-a016-5b0ff781989e tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.145705 May 05 14:06:08.248689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 940/1577] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:06:08 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:06:08.253074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:06:08.253983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:08.260009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.260467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.261234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.261680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.341019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a3084be-732b-4de8-8f16-fd4b2c8dbf0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action" status: 200 len: 82989 microversion: 2.1 time: 0.091149 May 05 14:06:08.341670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 941/1578] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 14:06:08 2022] POST /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/action => generated 82989 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 14:06:08.382844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:06:08.383995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:06:08.390976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.391429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:06:08.392192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:06:08.392630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.253653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:07:10.254364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:07:10.255224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ebaafc3-9a88-4b1c-a929-a2432e754ffe tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 114.729740 May 05 14:07:10.255865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 638/1579] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:05:15 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 114731 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:07:10.261084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:10.262092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:10.268194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.268753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.270485 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.270485 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.306978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a9322ef-a9af-4b78-8181-0c50c3423270 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050092 May 05 14:07:10.307531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 639/1580] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:07:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:07:10.311879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:10.312484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:10.318151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.318614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.319400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.319847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.363012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:07:10.389764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:07:10.399421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-725a030e-da6d-426a-9c1f-0701012d8e5b tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.088883 May 05 14:07:10.399421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 640/1581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:07:10 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:07:10.402696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:10.403311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:10.409398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.410130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:10.410903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:10.411203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.474864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99cf70bd-8ea8-4b05-9a8c-18ad9e53ea84) May 05 14:07:15.475659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-99cf70bd-8ea8-4b05-9a8c-18ad9e53ea84) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:07:15.476616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b313eb4-edeb-4fa8-82cf-ba3b6b9182ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 67.098222 May 05 14:07:15.477310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 942/1582] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:06:08 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 67100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 05 14:07:15.483962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:15.484468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:15.490381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.490839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.491607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.492046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.557537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:07:15.558179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:07:15.559012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee2538e1-90d7-414e-8ccc-7c5226d189a4 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 5.160001 May 05 14:07:15.559553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 641/1583] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:07:10 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 5161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:07:15.565488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:15.566461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:15.571948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.572397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.573162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.573603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.603277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-91c28700-91fa-4b4f-b146-2ada45337565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 May 05 14:07:15.603832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 642/1584] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:07:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:07:15.608121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:15.608732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] [instance: 3c3e07b2-6689-45b9-9da1-000c29490f34] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:15.614106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.614564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.615333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.615776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.674450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7b5849a9214c41ab39669aa1b62eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4ec75326b484292937db17eccee43f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:07:15.681777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4bfd4165-9307-419e-b117-efb29f299b5f tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34" status: 200 len: 1219 microversion: 2.1 time: 0.076988 May 05 14:07:15.682371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 643/1585] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:07:15 2022] GET /compute/v2.1/servers/3c3e07b2-6689-45b9-9da1-000c29490f34 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:07:15.687370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:07:15.687866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:07:15.693272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.693728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:07:15.694532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:07:15.695012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:09:10.487406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:09:10.526635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid e2d5d14e-9371-4d0f-8b25-22c081bab3d9 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:09:15.612439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4f4130a-948a-419c-b009-d62d72ce473a) May 05 14:09:15.613053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f4f4130a-948a-419c-b009-d62d72ce473a) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:09:15.613944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7a81781d-5872-4682-81ad-455779fcf577 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 120.135179 May 05 14:09:15.614628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 943/1586] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:07:15 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 120136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:09:15.620601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:09:15.621225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:09:15.627089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:09:15.627534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:09:15.628298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:09:15.628732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:09:15.787950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e3a2db08-9903-4fc0-9ca2-cc3547100287 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb" status: 202 len: 0 microversion: 2.1 time: 120.104380 May 05 14:09:15.788845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 644/1587] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:07:15 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb => generated 0 bytes in 120106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:09:15.794583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:09:15.795169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:09:15.801308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:09:15.801762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:09:15.802568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:09:15.803010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:10.916848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:11:10.916848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:10.916848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-daf09fda-1c32-461a-836f-acc07f089dc6 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 115.300379 May 05 14:11:10.916848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 944/1588] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:09:15 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 115301 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:11.044005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b9c36aa3-2c96-4602-9dad-cd3648fdea39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '.version_select at 0x7fb4ec227b80>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:11.114416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b9c36aa3-2c96-4602-9dad-cd3648fdea39 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282" status: 202 len: 0 microversion: 2.1 time: 0.196915 May 05 14:11:11.115190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 945/1589] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 14:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:11:11.130312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:11.235803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:11:11.236160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:11.242963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.243418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:11.244187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.244622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:11.317056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1090ba12-02ec-46bd-9173-d673660a4f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action" status: 200 len: 76727 microversion: 2.1 time: 0.199927 May 05 14:11:11.317844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 946/1590] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 14:11:11 2022] POST /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a/action => generated 76727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 05 14:11:11.323244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:11.323831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:11.330925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.331406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:11.332183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.332626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:11.707245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a0e87bc-9f57-4492-8efc-fcacc77ca3ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 202 len: 0 microversion: 2.1 time: 115.917018 May 05 14:11:11.708006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 645/1591] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:09:15 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 0 bytes in 115918 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:11:11.713726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:11.714350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:11.721158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.725387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:11.725387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:11.725387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:15.813301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:15.855769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid e2d5d14e-9371-4d0f-8b25-22c081bab3d9 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:15.965462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-20a30116-9462-4867-8752-c012e3e62edd) May 05 14:11:15.966550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-20a30116-9462-4867-8752-c012e3e62edd) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:15.967400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c392b860-a7b5-498a-9f79-6ec089fcc8a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 4.648304 May 05 14:11:15.968131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 947/1592] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:11 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 4650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:15.973674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:15.974195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:15.980895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:15.987273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:15.987273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:15.987273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.062222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16ab38eb-8ed7-4286-b340-a4ea0bce8405) May 05 14:11:16.062222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16ab38eb-8ed7-4286-b340-a4ea0bce8405) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.062448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a10fa8be-74d4-44b0-8983-685fbe08c5a5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb" status: 400 len: 269 microversion: 2.1 time: 4.353417 May 05 14:11:16.063178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 646/1593] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:11 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb => generated 269 bytes in 4355 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.067986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.068477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.074916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.075369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.076691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.077132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.102668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:11:16.103264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.104165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b8d66657-2b74-4816-ac37-665ee589b86e tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 0.134687 May 05 14:11:16.104860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 948/1594] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:11:15 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.109298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15a922e9-444c-4749-81e0-bf62de978968 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '.version_select at 0x7fb4e2e30700>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.126143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-15a922e9-444c-4749-81e0-bf62de978968 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac May 05 14:11:16.126741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15a922e9-444c-4749-81e0-bf62de978968 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.127609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-15a922e9-444c-4749-81e0-bf62de978968 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282" status: 404 len: 143 microversion: 2.1 time: 0.022005 May 05 14:11:16.128339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 949/1595] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282 => generated 143 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:11:16.132912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.133547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.141271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.141911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.142545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.143041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.162078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.222488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.252161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-073dd45e-e5bb-420a-a3f8-e65baa693e26) May 05 14:11:16.252801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-073dd45e-e5bb-420a-a3f8-e65baa693e26) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.253868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0cc4c9b4-c6bf-4ca4-849b-a6028c07eff8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 400 len: 269 microversion: 2.1 time: 0.189788 May 05 14:11:16.254464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 647/1596] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 269 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.259525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.260065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.266034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.266574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.267294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.267734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.285742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50087cdb-284f-4c7b-852c-a9914ad21fff) May 05 14:11:16.286399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-50087cdb-284f-4c7b-852c-a9914ad21fff) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.287255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-792846ac-5cfc-45f4-891c-e7047ea67fcf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 0.158063 May 05 14:11:16.287809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 950/1597] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.292586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.293073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.299824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.300272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.301037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.301476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.351390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid e2d5d14e-9371-4d0f-8b25-22c081bab3d9 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.385477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:11:16.386109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.386998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f9c3fa4a-5c34-493c-851a-0770d02b25e1 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 0.098214 May 05 14:11:16.387593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 951/1598] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.392331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.392809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.398837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.399293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.400075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.400514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.413686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b598a8f-68ec-41b7-8332-6e2204f6b3a1) May 05 14:11:16.414402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b598a8f-68ec-41b7-8332-6e2204f6b3a1) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.415324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-17ccb8a2-ae59-4ec1-b356-2a2caadbb274 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb" status: 400 len: 269 microversion: 2.1 time: 0.159954 May 05 14:11:16.415919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 648/1599] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb => generated 269 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.422417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc56af41-f4bb-4367-b314-999392b7f965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '.version_select at 0x7fb4e8353280>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.436894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-dc56af41-f4bb-4367-b314-999392b7f965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac May 05 14:11:16.438005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc56af41-f4bb-4367-b314-999392b7f965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.439076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dc56af41-f4bb-4367-b314-999392b7f965 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282" status: 404 len: 143 microversion: 2.1 time: 0.022207 May 05 14:11:16.439880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 649/1600] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282 => generated 143 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:11:16.445459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.446134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.452333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.453118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.453779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.454245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.480493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.532701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.559912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eace2880-2174-4240-9d57-b94ce7619734) May 05 14:11:16.561176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eace2880-2174-4240-9d57-b94ce7619734) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.562043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a70b7f2-86d1-41ea-95e9-f15627f76040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 400 len: 269 microversion: 2.1 time: 0.173547 May 05 14:11:16.562714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 952/1601] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 269 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.567474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.568128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.573911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.574404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.575150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.575581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.593810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c8b0a93-ae70-4aea-bc28-b8a2354d7aed) May 05 14:11:16.594553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3c8b0a93-ae70-4aea-bc28-b8a2354d7aed) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.595474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-16d45469-78df-4885-a2b8-449bf7a70fa5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 0.154573 May 05 14:11:16.596041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 650/1602] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.601142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.601633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.608106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.608554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.609317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.609755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.655173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid e2d5d14e-9371-4d0f-8b25-22c081bab3d9 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.694137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:11:16.694974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.695812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ab284b17-eec5-49c7-b216-d356c57ee0df tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 0.098862 May 05 14:11:16.696360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 651/1603] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.701672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.702190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.708922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.712892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.712892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.712892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.725660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e956eacd-eb30-46db-97c4-0e94ace74874) May 05 14:11:16.727109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e956eacd-eb30-46db-97c4-0e94ace74874) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.728358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05e67b61-34c3-4832-80a3-2b8ed44f2900 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb" status: 400 len: 269 microversion: 2.1 time: 0.164545 May 05 14:11:16.728982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 953/1604] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb => generated 269 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.734004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db217b16-d9f7-4072-a5ad-388ab0b0ba31 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '.version_select at 0x7fb4ec2279d0>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.744307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-db217b16-d9f7-4072-a5ad-388ab0b0ba31 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac May 05 14:11:16.744891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db217b16-d9f7-4072-a5ad-388ab0b0ba31 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.745703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db217b16-d9f7-4072-a5ad-388ab0b0ba31 tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282" status: 404 len: 143 microversion: 2.1 time: 0.015576 May 05 14:11:16.746446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 954/1605] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282 => generated 143 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:11:16.753811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.754330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.760062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.760499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.761268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.761722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.794363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.841748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lazy-loading 'services' on Instance uuid 11a3b3a4-b7f6-4697-a2b4-11913492a055 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:16.868934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-53405708-2f4f-436b-a923-d5573910240f) May 05 14:11:16.869543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-53405708-2f4f-436b-a923-d5573910240f) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.870551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f9d7e3a3-29b8-466a-8bde-1d4ed6b2c263 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 400 len: 269 microversion: 2.1 time: 0.173266 May 05 14:11:16.871118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 652/1606] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 269 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.876400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.876904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.883379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.883379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.884226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.884667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.904596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee548853-f55c-4aa9-bb6a-50cce57a4486) May 05 14:11:16.905248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee548853-f55c-4aa9-bb6a-50cce57a4486) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:16.906049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2c2a6c5-700c-4ae1-9c90-5f68330d1852 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a" status: 400 len: 269 microversion: 2.1 time: 0.158833 May 05 14:11:16.906632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 955/1607] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055/os-volume_attachments/f4622437-72cd-4938-ae83-295e54ae151a => generated 269 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:16.911987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:16.912516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:16.919253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.919702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:16.920500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:16.920935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.033141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lazy-loading 'services' on Instance uuid e2d5d14e-9371-4d0f-8b25-22c081bab3d9 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:17.077790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b May 05 14:11:17.078455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 is not attached to volume 2f466cd5-2b53-433a-9c05-5d2b17f46e6b {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:17.079462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec80db4d-9e03-48df-9b3e-f5c46b4bc7a8 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b" status: 404 len: 154 microversion: 2.20 time: 0.171851 May 05 14:11:17.080048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 956/1608] 10.222.0.26 () {60 vars in 1456 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments/2f466cd5-2b53-433a-9c05-5d2b17f46e6b => generated 154 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:17.087619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:17.088653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:17.108434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.108945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.109752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.110242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.164864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98d239e4-7bf4-4494-9683-5091dee750cf) May 05 14:11:17.165475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98d239e4-7bf4-4494-9683-5091dee750cf) {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:17.166390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8228c706-138b-48b9-8ce3-896f1256668e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb" status: 400 len: 269 microversion: 2.1 time: 0.294277 May 05 14:11:17.166951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 653/1609] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:16 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9/os-volume_attachments/41d32857-c7c5-4ec2-907f-cb49c41e09eb => generated 269 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:17.172309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3f813f62-4f06-414c-a0fc-c449042c0d7c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Calling method '.version_select at 0x7fb4e803fd30>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:17.182254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-3f813f62-4f06-414c-a0fc-c449042c0d7c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] HTTP exception thrown: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac May 05 14:11:17.182829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3f813f62-4f06-414c-a0fc-c449042c0d7c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] Returning 404 to user: Keypair tempest-TestShelveInstance-1069373282 not found for user df7b5849a9214c41ab39669aa1b62eac {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:17.183766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3f813f62-4f06-414c-a0fc-c449042c0d7c tempest-TestShelveInstance-752871606 tempest-TestShelveInstance-752871606-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282" status: 404 len: 143 microversion: 2.1 time: 0.015794 May 05 14:11:17.184139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 654/1610] 10.222.0.26 () {58 vars in 1253 bytes} [Thu May 5 14:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1069373282 => generated 143 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:11:17.218424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:17.219597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:17.226101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.226744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.235096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.235096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.260492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a833568c-95a4-44dc-8cc7-d218a6de7282 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046878 May 05 14:11:17.260636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'services' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:11:17.265928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 655/1611] 10.222.0.26 () {60 vars in 1342 bytes} [Thu May 5 14:11:17 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:11:17.361969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:17.362760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:17.369269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.369752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.370566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.370995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.385385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4aa80c77-05e3-4b1c-b8df-d3f69b78e756) May 05 14:11:17.385999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4aa80c77-05e3-4b1c-b8df-d3f69b78e756) {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:17.386877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8c473b0a-80a5-4fee-8eea-320ff7113e9a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f" status: 400 len: 269 microversion: 2.1 time: 0.305929 May 05 14:11:17.387425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 957/1612] 10.222.0.26 () {58 vars in 1415 bytes} [Thu May 5 14:11:17 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments/88d55e17-b491-455d-961b-13e85bb1779f => generated 269 bytes in 307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:17.397043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:17.398051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:17.398200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:11:17.404912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.compute.api [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Working on deleting snapshot ce1e32f7-6900-4537-afd2-a03f5f2d7b5d from shelved instance... May 05 14:11:17.405303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.405752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.406562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:17.407004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:17.447016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-67ce8c6d-22cb-44e9-90e6-ea8e55d7525f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054085 May 05 14:11:17.447591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 958/1613] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:11:18.458913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:18.459845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:18.466197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:18.466683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:18.467445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:18.467885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:18.496885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aa04c484-1c3d-4477-88bb-a0cf94f01594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041928 May 05 14:11:18.497438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 959/1614] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:11:18.782648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Doing local delete in cell b8fe454e-7513-4ff7-93a5-967e7a71a07d(cell1) {{(pid=123931) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 05 14:11:18.783466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:18.783929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:18.784342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.compute.api [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 05 14:11:18.787912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] deallocate_for_instance() {{(pid=123931) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 05 14:11:19.508814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:19.509746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:19.515873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:19.516324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:19.517099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:19.517537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:19.549487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4664976a-2bd5-4f21-b26b-759c46e75737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044419 May 05 14:11:19.550404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 960/1615] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:11:20.558003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-ade5ea55-eef9-4116-83cb-273a9a4359d9 req-2af67176-dab2-44a2-9735-fe4897a51b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93818186-77bc-406b-8664-b67f320534c5", "name": "network-vif-deleted", "tag": "eda82bc2-7da3-440e-8aee-53635c08bbe1"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:11:20.570138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Updating instance_info_cache with network_info: [] {{(pid=123931) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 05 14:11:20.575956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-ade5ea55-eef9-4116-83cb-273a9a4359d9 req-2af67176-dab2-44a2-9735-fe4897a51b4c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:20.576860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-ade5ea55-eef9-4116-83cb-273a9a4359d9 req-2af67176-dab2-44a2-9735-fe4897a51b4c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:20.590042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.compute.server_external_events [req-ade5ea55-eef9-4116-83cb-273a9a4359d9 req-2af67176-dab2-44a2-9735-fe4897a51b4c service nova] Unable to find a host for instance 93818186-77bc-406b-8664-b67f320534c5. Dropping event network-vif-deleted {{(pid=123930) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 05 14:11:20.590927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-ade5ea55-eef9-4116-83cb-273a9a4359d9 req-2af67176-dab2-44a2-9735-fe4897a51b4c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.091777 May 05 14:11:20.591514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 961/1616] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 93 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 05 14:11:20.596199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:20.597113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:20.603448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:20.604138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:20.605076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:20.605676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:20.644743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30b6e0a2-c5bb-4c4e-b4ff-ec9119b8b0bf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052111 May 05 14:11:20.645325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 962/1617] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:21.371566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cb54b130-1abb-4058-8b2d-b5ac5155596f tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 204 len: 0 microversion: 2.20 time: 4.011735 May 05 14:11:21.371566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 656/1618] 10.222.0.26 () {60 vars in 1279 bytes} [Thu May 5 14:11:17 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 0 bytes in 4014 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 05 14:11:21.383711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:21.385686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:21.392605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:21.393057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:21.394085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:21.394543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:21.428301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. May 05 14:11:21.435783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:11:21.435783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6873465d-ce8e-40c7-89d0-d1abec0bd97c tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 404 len: 111 microversion: 2.20 time: 0.052378 May 05 14:11:21.437892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 963/1619] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:11:21 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:11:21.444446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75a89759-0539-44cd-9728-c91a39bfcd04 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '.version_select at 0x7fb4e82893a0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:21.575120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75a89759-0539-44cd-9728-c91a39bfcd04 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392666370" status: 204 len: 0 microversion: 2.20 time: 0.135148 May 05 14:11:21.578324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 657/1620] 10.222.0.26 () {60 vars in 1261 bytes} [Thu May 5 14:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392666370 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 05 14:11:21.662122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:21.663763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:21.672300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:21.673544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:21.674662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:21.675936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:21.710442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c857d6ad-670c-46c8-b38a-c73f6ebf20fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054177 May 05 14:11:21.712239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 964/1621] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:22.722418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:22.723632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:22.734632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:22.738243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:22.738243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:22.738243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:22.768136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-49e714db-f910-4c2a-843f-61fcc5260fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049969 May 05 14:11:22.768718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 658/1622] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:23.780783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:23.782355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:23.790266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:23.790922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:23.791894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:23.792324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:23.826446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-df3f6050-6385-45b9-8b4f-390469bfcbd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049805 May 05 14:11:23.827681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 965/1623] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:24.838458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:24.839473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:24.845796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:24.846281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:24.847058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:24.847500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:24.878053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e20463c0-5d4f-4f48-ab92-97ed2373a187 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 May 05 14:11:24.878635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 659/1624] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:25.890306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:25.892207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:25.900389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:25.900794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:25.901582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:25.902051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:25.954484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-18547168-9c46-4ea2-97e5-b51d23dbcf07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069362 May 05 14:11:25.955487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 966/1625] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:26.966997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:26.967941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:26.974608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:26.975416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:26.976211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:26.976708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:27.010601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5930f8d1-2f99-4466-8b3e-f6c54d68e5c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 May 05 14:11:27.011257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 660/1626] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:28.022799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:28.023941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:28.030986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:28.031445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:28.032233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:28.032687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:28.064735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8952e213-8410-46a6-a2ed-cf78151eb96e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 May 05 14:11:28.065763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 967/1627] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:29.076358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:29.077313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:29.083601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:29.084079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:29.084836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:29.085502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:29.119065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-47ed5790-817a-4567-b903-d99174bbead0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046610 May 05 14:11:29.119621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 661/1628] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:30.130676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:30.131615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:30.137987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:30.138498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:30.140194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:30.140382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:30.169405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-02d82dce-9c8e-4c29-b5ca-af24a24ed1af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 May 05 14:11:30.169972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 968/1629] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:31.181134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:31.183266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:31.189312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:31.189755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:31.190542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:31.190986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:31.219742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e34f43fc-8997-49c1-a641-22adfea85c5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042636 May 05 14:11:31.220292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 662/1630] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:32.231637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:32.232487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:32.239380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:32.239833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:32.240602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:32.241043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:32.269975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eed8e624-7f4b-443c-a7d3-423ba9aaf301 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 May 05 14:11:32.270568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 969/1631] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:33.281899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:33.282850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:33.289066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:33.289507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:33.290290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:33.290721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:33.320406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-91fe9c26-dd88-4051-a1c0-71642879b590 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 May 05 14:11:33.320967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 663/1632] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:34.331236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:34.332170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:34.338622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:34.339076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:34.339845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:34.340286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:34.369769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a8b6eab1-f825-4adf-962c-f7323ba3e725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042477 May 05 14:11:34.370267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 970/1633] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:35.382261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:35.383326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:35.391014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:35.391465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:35.392834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:35.393266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:35.427969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ec654cd-d359-4239-ac3a-9b46daf8e279 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049794 May 05 14:11:35.428755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 664/1634] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:36.439950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:36.440887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:36.447252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:36.447713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:36.448478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:36.448915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:36.479170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7df8a191-28bb-49b7-a381-0f40d720ad31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 May 05 14:11:36.479725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 971/1635] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:37.490187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:37.491059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:37.497347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:37.497800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:37.499164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:37.499597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:37.528235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-272cc843-3bf6-490c-ba2b-08944e313dd4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042077 May 05 14:11:37.528784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 665/1636] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:38.539899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:38.540832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:38.547913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:38.548467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:38.549240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:38.549682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:38.578568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-801ad0af-d933-407f-9733-18bb5d381457 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042566 May 05 14:11:38.579131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 972/1637] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:39.589244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:39.590208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:39.596438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:39.596885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:39.597646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:39.598115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:39.627577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b5121e53-7ebf-44f2-9640-303d4e74093e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 May 05 14:11:39.628136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 666/1638] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:40.640052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:40.640979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:40.647229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:40.647674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:40.648428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:40.648861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:40.676991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d9a6d8d7-4868-4861-b3a9-47e681456d25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041519 May 05 14:11:40.677547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 973/1639] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:41.687909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:41.688841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:41.695308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:41.695763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:41.696556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:41.696987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:41.726948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92f88095-32b9-4605-8841-5b9575282be5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 May 05 14:11:41.727509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 667/1640] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:11:42.739221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:42.740085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:42.746415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:42.746863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:42.747621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:42.748056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:42.777169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b7654bb-cabe-4107-96eb-ba6e6ba6380d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 May 05 14:11:42.777727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 974/1641] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:43.788853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:43.797185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:43.803571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:43.804024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:43.804795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:43.805240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:43.834644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5cef92cf-df1e-4fae-9765-0fcc622731cf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049900 May 05 14:11:43.835210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 668/1642] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:44.846793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:44.847733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:44.854449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:44.854912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:44.855679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:44.856126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:44.884171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c28079ba-d8d1-4104-99de-2bb0eb71cd50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 May 05 14:11:44.884792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 975/1643] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:45.895108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:45.896047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:45.902444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:45.902901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:45.903677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:45.904118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:45.938531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4c172be0-74df-44fc-82f1-094bd4634afd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 May 05 14:11:45.939235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 669/1644] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:46.951076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:46.952153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:46.958639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:46.959094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:46.959861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:46.960301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:46.989850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3e17f368-d4df-4301-86bf-7a19ad315565 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 May 05 14:11:46.990457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 976/1645] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:48.001541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:48.002449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:48.008770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:48.009214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:48.009965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:48.010422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:48.040768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e15580ae-e357-4213-bc02-5f45c21406dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 May 05 14:11:48.041327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 670/1646] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:49.052983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:49.053836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:49.060186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:49.060639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:49.061404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:49.061846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:49.089467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8258c468-d982-4756-94ad-cbbc09fde54c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040545 May 05 14:11:49.090031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 977/1647] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:50.101256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:50.102217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:50.108324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:50.108777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:50.109545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:50.109987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:50.140215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ac882ed-f76c-489e-8c70-2f04a2b84be6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 May 05 14:11:50.140779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 671/1648] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:51.151707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:51.152630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:51.158960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:51.159405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:51.160162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:51.160595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:51.188067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c64d6796-d763-4e75-a284-39749ee3cb44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040341 May 05 14:11:51.189116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 978/1649] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:52.200206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:52.201075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:52.207939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:52.208392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:52.209161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:52.209600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:52.238205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bd25ba8b-eacc-4bee-9e6c-854cda7caa03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 May 05 14:11:52.238754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 672/1650] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:53.249054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:53.249984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:53.256925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:53.257381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:53.258183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:53.258628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:53.287095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a6dd8c36-7064-4648-9e07-c0e049de125a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042019 May 05 14:11:53.287643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 979/1651] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:54.299819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:54.300742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:54.307069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:54.307516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:54.308265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:54.308696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:54.336143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cdbd190f-6cea-40e1-94c0-6a62e27e8337 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 May 05 14:11:54.336676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 673/1652] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:55.347600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:55.348522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:55.355154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:55.355551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:55.356362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:55.356799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:55.386626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-366445bb-a852-44ce-8f67-729f8474d331 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 May 05 14:11:55.387184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 980/1653] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:56.398417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:56.399351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:56.405683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:56.406185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:56.406961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:56.407926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:56.436353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2a3653c-9c14-4d38-a482-01ff1bc73ca7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041937 May 05 14:11:56.436900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 674/1654] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:57.447935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:57.448870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:57.455734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:57.456191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:57.456957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:57.457564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:57.485965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-317f9ccc-5a3a-4774-bb93-2e41a66f1083 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042009 May 05 14:11:57.486547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 981/1655] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:58.497437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:58.498396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:58.505283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:58.505735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:58.506540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:58.506983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:58.535094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3748ae82-f40b-4123-817b-018d6e054ad2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 May 05 14:11:58.535633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 675/1656] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:11:59.546621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:11:59.547459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:11:59.554238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:59.554689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:59.555449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:11:59.555893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:11:59.583912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2335a7d2-1a68-4b0b-af99-d637545a362d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041281 May 05 14:11:59.584455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 982/1657] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:11:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:00.595370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:00.596296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:00.602915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:00.603392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:00.604165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:00.604606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:00.634882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f27bcbd9-f292-4381-a029-f04359959bf5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 May 05 14:12:00.635445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 676/1658] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:01.647409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:01.648390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:01.654718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:01.655166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:01.655934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:01.656366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:01.684772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bafb970d-a5ae-40ff-8819-1a4882b41c18 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041504 May 05 14:12:01.685334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 983/1659] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:02.696650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:02.697497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:02.703819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:02.704272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:02.705541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:02.705981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:02.734475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76a1fea6-2036-44c7-91b8-f74ff0f37f4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041872 May 05 14:12:02.735022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 677/1660] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:03.746142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:03.747031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:03.753893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:03.754374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:03.755147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:03.755590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:03.784543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2e89f3c-04ae-4b77-987a-4889469c0c8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 May 05 14:12:03.785092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 984/1661] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:04.796393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:04.797236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:04.803641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:04.804096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:04.804855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:04.805292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:04.833902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-25d9f1fa-c3f3-4e47-a546-74e36bec66c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 May 05 14:12:04.834475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 678/1662] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:05.845470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:05.846521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:05.853234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:05.853683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:05.854477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:05.854914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:05.891381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0078a049-3fcc-41c5-9468-4fc38b80832c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 May 05 14:12:05.891969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 985/1663] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:06.903016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:06.903951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:06.910368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:06.910822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:06.911593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:06.912032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:06.940814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e6dc1da-428e-44a5-a115-06aec6796f24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041732 May 05 14:12:06.941355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 679/1664] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:07.952217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:07.953084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:07.959893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:07.960337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:07.961091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:07.961522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:07.989900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0114f1ca-2233-4758-b484-d5c9b0b981bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041734 May 05 14:12:07.990479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 986/1665] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:09.001337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:09.002865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:09.009169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:09.009618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:09.010406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:09.010846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:09.038789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ace95432-25e3-418b-816d-06db17826854 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 May 05 14:12:09.039329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 680/1666] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:10.050492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:10.051420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:10.057753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:10.058269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:10.059045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:10.059483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:10.091682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dfe13ff4-631c-482c-9c9c-b99ca3329814 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 May 05 14:12:10.092258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 987/1667] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:11.103746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:11.104486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:11.110798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:11.111757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:11.112518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:11.112955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:11.140979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-43de531e-06aa-4fb8-911c-aa460edf6270 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 May 05 14:12:11.141512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 681/1668] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:12.152579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:12.153526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:12.160056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:12.160508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:12.161278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:12.161715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:12.189951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f21179b4-4f29-41cb-bea7-516d05f42af6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040863 May 05 14:12:12.190528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 988/1669] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:13.201480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:13.202446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:13.209207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:13.209674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:13.210466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:13.210913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:13.240630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df588a30-bcbf-48ce-8861-8ae620fd20b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 May 05 14:12:13.241184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 682/1670] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:14.252190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:14.253123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:14.259621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:14.260072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:14.260838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:14.261277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:14.289808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-12457a56-b5c7-477c-a179-6dc5a679b76c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 May 05 14:12:14.290377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 989/1671] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:15.301900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:15.302904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:15.309221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:15.309597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:15.310392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:15.310838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:15.339239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-16a6bb29-6145-469e-aed7-78252fffe25b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041952 May 05 14:12:15.339792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 683/1672] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:16.351707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:16.352627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:16.359109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:16.359530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:16.360286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:16.360722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:16.389258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-81d5bb66-f04e-4e4b-a03e-c546bc8c3f1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 May 05 14:12:16.389807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 990/1673] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:17.400719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:17.401674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:17.408131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:17.408591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:17.409360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:17.409811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:17.440094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bb86c263-586b-4663-99ad-0655bd7de95b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 May 05 14:12:17.440648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 684/1674] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:12:18.451755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:18.452685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:18.459573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:18.460028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:18.460823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:18.461262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:18.490145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-35e547dc-584c-4e3d-814d-f88d0ca605cd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 May 05 14:12:18.490706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 991/1675] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:19.500838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:19.501772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:19.508292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:19.508745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:19.509505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:19.509940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:19.538384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2c0225f6-dccd-4a79-afc4-7c3af46c8831 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041441 May 05 14:12:19.538925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 685/1676] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:20.549538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:20.551143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:20.557329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:20.557774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:20.558564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:20.558997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:20.587039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-457441c5-e323-4752-b86d-e3ab381e305f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 May 05 14:12:20.587580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 992/1677] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:21.598965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:21.599910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:21.606700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:21.607147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:21.607909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:21.608346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:21.636951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8bdeee48-8f1c-4dc0-8b06-9ebc17754040 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 May 05 14:12:21.637486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 686/1678] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:22.649190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:22.650133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:22.656373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:22.656815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:22.657569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:22.658001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:22.685734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-27dc233e-5a61-48d5-880e-61e7a7b4e6c3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 May 05 14:12:22.686311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 993/1679] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:23.697157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:23.698107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:23.706459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:23.707419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:23.708188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:23.708623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:23.738856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ca9765e6-4b7f-4587-865e-bf7b634933b7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 May 05 14:12:23.739424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 687/1680] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:24.750787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:24.751738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:24.757982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:24.758462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:24.759215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:24.759676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:24.787683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ccc1e35-f0ef-42b3-b02a-9f56e5293737 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041005 May 05 14:12:24.788224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 994/1681] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:25.799073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:25.800037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:25.806930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:25.807382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:25.808153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:25.808592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:25.836616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8d8d56f0-3d4b-40b1-8a2c-b0ed36b7f906 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 May 05 14:12:25.837149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 688/1682] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:26.848743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:26.849706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:26.856245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:26.856688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:26.857440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:26.857887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:26.886813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a3d4a9e3-75ac-4517-a401-ac66fbc1f234 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042851 May 05 14:12:26.887368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 995/1683] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:27.898223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:27.899151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:27.905484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:27.905936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:27.906737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:27.907178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:27.936062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a15d502e-077b-4e4a-83d7-00ac8e228685 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 May 05 14:12:27.936606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 689/1684] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:28.947364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:28.948306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:28.954315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:28.954768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:28.955532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:28.955972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:28.984932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4156f053-b764-4d87-8652-97ac0efded43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041522 May 05 14:12:28.985478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 996/1685] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:29.997201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:29.998159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:30.004404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:30.004854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:30.005613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:30.006078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:30.034700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1046ae28-5d57-4b21-9cd7-693281d453d3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041981 May 05 14:12:30.035247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 690/1686] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:31.046733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:31.047656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:31.054389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:31.054838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:31.055621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:31.056063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:31.084197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8e529e78-edb3-4ba2-96ea-46e6c3e2cdec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041428 May 05 14:12:31.084732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 997/1687] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:32.095672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:32.096725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:32.104117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:32.104576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:32.105371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:32.105816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:32.140625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8136eba7-1c40-466e-a610-fe71866ade55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 May 05 14:12:32.141311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 691/1688] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:33.152609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:33.153539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:33.159964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:33.160419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:33.161191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:33.162185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:33.190937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1733fb01-f3c9-43b4-9b04-a57b519c38dc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042238 May 05 14:12:33.191409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 998/1689] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:34.201545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:34.202500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:34.208794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:34.209244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:34.210009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:34.210469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:34.238229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-540f9f10-f19d-40ca-8db5-271205ff1f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040542 May 05 14:12:34.238774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 692/1690] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:35.250178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:35.251148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:35.257483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:35.257944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:35.258747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:35.259207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:35.288194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e7a4671-b5d1-4e68-b98e-c67061038f17 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041970 May 05 14:12:35.288752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 999/1691] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:36.299634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:36.300573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:36.306915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:36.307373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:36.308145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:36.308588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:36.338099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-87c8a8d6-3d87-4ec3-8697-402d0ac5a463 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 May 05 14:12:36.338650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 693/1692] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:37.349905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:37.351368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:37.361484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:37.361484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:37.361484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:37.361484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:37.387801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c28f57d-e53b-4aa1-8662-a835533511d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 May 05 14:12:37.388342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1000/1693] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:38.399347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:38.400274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:38.406667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:38.407123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:38.407883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:38.408322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:38.436909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a9cedb8-8812-4666-a2cd-9c9cb0039d30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 May 05 14:12:38.437447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 694/1694] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:39.448992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:39.449919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:39.456207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:39.456656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:39.457415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:39.457853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:39.486201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5427f3f0-3d77-4a2e-bf41-925c435cb4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041124 May 05 14:12:39.486748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1001/1695] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:40.496757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:40.497814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:40.504274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:40.504718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:40.505676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:40.506138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:40.535857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-89e199e7-4f4e-4ee7-add7-d5c62d79f95f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 May 05 14:12:40.536511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 695/1696] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:41.547553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:41.548466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:41.554717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:41.555168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:41.555922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:41.556359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:41.585815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2af7dcd4-8b8a-4f5a-ad4e-e272b75a94e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042063 May 05 14:12:41.586511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1002/1697] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:42.597406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:42.598389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:42.605420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:42.605896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:42.606692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:42.607133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:42.635392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c53c997a-1d13-40ff-baa7-b1f49cb0d4fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 May 05 14:12:42.635926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 696/1698] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:43.647508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:43.648460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:43.654823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:43.655276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:43.656043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:43.656479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:43.685291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-16a1e84e-f2dd-4314-9aa0-1ce5afb65210 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042386 May 05 14:12:43.685837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1003/1699] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:44.696568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:44.697523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:44.703903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:44.704345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:44.705134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:44.705565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:44.734456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69031602-7a31-4889-b849-ba4bae16fb31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041714 May 05 14:12:44.734993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 697/1700] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:45.745506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:45.746471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:45.752771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:45.753221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:45.753986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:45.754448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:45.783916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4be31f5c-a40d-4f24-bf03-0db8199fab2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042547 May 05 14:12:45.784467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1004/1701] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:46.795627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:46.796882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:46.803211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:46.803662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:46.804502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:46.805067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:46.832927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2e69c2fe-b201-468b-bd31-aded97f073e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041239 May 05 14:12:46.833468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 698/1702] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:47.844731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:47.845661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:47.854617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:47.855072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:47.855850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:47.856289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:47.884968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c87d7c60-92c1-4ef8-89d0-2d0fa264de20 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 May 05 14:12:47.885514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1005/1703] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:48.897826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:48.898785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:48.906308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:48.906762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:48.908318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:48.908771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:48.938682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f9b8ed51-0f86-4109-8273-7afdcc754b2a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 May 05 14:12:48.939237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 699/1704] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:49.950385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:49.951311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:49.957603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:49.958077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:49.958867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:49.959834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:49.989222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d1bda4ec-9e50-45b0-aeef-1185d604aa7d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042881 May 05 14:12:49.989771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1006/1705] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:51.001199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:51.002214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:51.008294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:51.008741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:51.009499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:51.009934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:51.038347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7b7ab72f-3d7f-4414-8ba0-af2bc442516b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040964 May 05 14:12:51.038884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 700/1706] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:52.048629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:52.049565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:52.056043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:52.056492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:52.057361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:52.057796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:52.085886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bcbbb188-0e4a-4986-b802-27df33a08b94 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 May 05 14:12:52.086455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1007/1707] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:53.096926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:53.097869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:53.105671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:53.105671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:53.106413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:53.106858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:53.136718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-759cd03d-50b7-4b74-85c7-79dc7756ecda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 May 05 14:12:53.137273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 701/1708] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:54.148836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:54.149888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:54.156330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:54.156791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:54.157558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:54.157997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:54.186335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cba71c70-51b5-4088-8ce7-65615c49d93b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 May 05 14:12:54.186875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1008/1709] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:55.196859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:55.197788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:55.204130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:55.204523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:55.205301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:55.205741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:55.235420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-128b5b79-8793-4a89-a6f2-19e122d63834 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042462 May 05 14:12:55.235968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 702/1710] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:56.247311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:56.248246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:56.254590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:56.255054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:56.255825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:56.263256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:56.284584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b8e88b85-3356-4aac-88dc-b7a0a572ae9d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041149 May 05 14:12:56.285127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1009/1711] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:57.296309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:57.297230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:57.303523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:57.303972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:57.309915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:57.309915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:57.335753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-62c39b99-0965-45e5-8492-53a3c2098528 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 May 05 14:12:57.336314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 703/1712] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:58.347236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:58.348167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:58.355043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:58.355496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:58.356258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:58.356699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:58.385665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b2c6ab77-8a58-43f7-b7f3-ebfcaa183709 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 May 05 14:12:58.386256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1010/1713] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:12:59.396712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:12:59.397645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:12:59.404095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:59.404547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:59.405321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:12:59.405761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:12:59.435874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-99a61619-1990-4ea7-87c3-dd86cd12be41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 May 05 14:12:59.436425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 704/1714] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:12:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:13:00.447753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:00.448682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:00.454707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:00.455155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:00.455924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:00.456361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:00.484758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bb9ab9a8-25b5-4562-90db-c39b5c7eeeb4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 May 05 14:13:00.485303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1011/1715] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:01.495941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:01.496898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:01.503124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:01.503582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:01.504382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:01.504822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:01.534426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-724cece0-e8f8-4a52-b065-413575059aac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 May 05 14:13:01.534984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 705/1716] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:02.545706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:02.546689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:02.552909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:02.553356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:02.554141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:02.554573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:02.582678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a7b83bac-404f-4bfc-8239-35a3bc9ce276 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040823 May 05 14:13:02.583224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1012/1717] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:03.597445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:03.598404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:03.605917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:03.606406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:03.607194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:03.607639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:03.640944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f1da627b-1613-4675-919f-20a311f49e10 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 May 05 14:13:03.641507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 706/1718] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:04.652353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:04.653322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:04.659665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:04.660122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:04.660891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:04.661334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:04.690293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f6982f97-1eaf-4b9c-b6e5-31d12f32d281 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041860 May 05 14:13:04.690854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1013/1719] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:05.702519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:05.703451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:05.709817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:05.710319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:05.711085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:05.711527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:05.740798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-def0cdf5-ee86-47d3-8627-952170be470e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 May 05 14:13:05.741350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 707/1720] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:06.752245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:06.753222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:06.760169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:06.760616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:06.761386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:06.761822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:06.791550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf880621-0f65-4e28-a6db-2e1d548c3980 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043315 May 05 14:13:06.792091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1014/1721] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:07.802734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:07.803671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:07.810023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:07.810501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:07.811276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:07.811729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:07.840555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e127b3e1-4177-48b4-9017-a2934ced0850 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041705 May 05 14:13:07.841107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 708/1722] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:08.852352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:08.853228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:08.859660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:08.860117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:08.860894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:08.861340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:08.891219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1eaa0726-416c-426e-80a6-95268d4cc8cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 May 05 14:13:08.891776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1015/1723] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:09.903197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:09.904130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:09.910396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:09.910851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:09.911630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:09.912069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:09.940486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-99ee14f0-734b-4e48-8dd4-d3a5332db136 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041159 May 05 14:13:09.941028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 709/1724] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:10.952349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:10.953320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:10.960164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:10.960627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:10.961404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:10.961847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:10.991817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-36da65b8-8da2-4c2f-ab44-c1633dcc93a4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043407 May 05 14:13:10.992349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1016/1725] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:12.002433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:12.003363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:12.010256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:12.010707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:12.011498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:12.011933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:12.040698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8e5afa66-f418-4ce0-a276-6effd11a81bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 May 05 14:13:12.041282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 710/1726] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:13.052214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:13.053645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:13.060044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:13.060490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:13.061259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:13.061712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:13.091013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3851e789-799f-4068-b225-0625638b8b30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 May 05 14:13:13.091570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1017/1727] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:14.103555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:14.104706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:14.113812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:14.114496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:14.116021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:14.116464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:14.144618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df6c1619-ecb4-4564-b4ae-f0d18d262541 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 May 05 14:13:14.145177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 711/1728] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:15.156073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:15.157005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:15.164016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:15.164467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:15.165243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:15.165680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:15.195553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75ec4d0b-d460-4102-9bb6-d566138195b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 May 05 14:13:15.196118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1018/1729] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:16.207056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:16.207977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:16.214358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:16.214838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:16.215611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:16.216043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:16.245251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a1faff2-39e7-4511-bbf7-cf82bff6209f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 May 05 14:13:16.245790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 712/1730] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:17.256718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:17.257646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:17.264089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:17.264610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:17.265383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:17.265823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:17.295693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6833d09a-05ea-48a4-b642-fe560c1bd7e1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042832 May 05 14:13:17.296084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1019/1731] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:18.307576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:18.308465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:18.314734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:18.315173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:18.315941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:18.316371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:18.344686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5581cc75-73c8-439e-9bc3-763bd52e2416 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041117 May 05 14:13:18.345244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 713/1732] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:19.356830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:19.357840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:19.364249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:19.364898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:19.366210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:19.366664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:19.394833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-02dde27f-2453-4989-b7c1-93b36f0cd9df tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 May 05 14:13:19.395433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1020/1733] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:20.405717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:20.406704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:20.413304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:20.413760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:20.414569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:20.415018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:20.444377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0602ae15-bdca-43e0-8a09-53911b9bd28d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 May 05 14:13:20.444933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 714/1734] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:21.455934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:21.456856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:21.463811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:21.464255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:21.465014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:21.465450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:21.507369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8bad3fa2-99a2-43d5-b472-a95908a929b5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055369 May 05 14:13:21.507936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1021/1735] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:22.518815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:22.519824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:22.526176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:22.526637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:22.527415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:22.527856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:22.558787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aeec3bd6-dfbc-4db0-a05b-9428061ece76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 May 05 14:13:22.559348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 715/1736] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:23.571186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:23.572148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:23.578699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:23.579151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:23.579916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:23.580365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:23.612018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8aa289aa-fdcb-42ac-87c9-1bc2c3a3968e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 May 05 14:13:23.612018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1022/1737] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:24.621590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:24.622669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:24.629411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:24.629895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:24.631205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:24.631638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:24.663894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a844dc2-e1b5-4837-bcfa-4f94d1fb1b1b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 May 05 14:13:24.664449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 716/1738] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:25.674873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:25.675807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:25.682610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:25.683090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:25.683833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:25.684274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:25.712890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b2e3dfe-3d1c-42ab-b785-0baa98939f2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042044 May 05 14:13:25.713441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1023/1739] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:26.725112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:26.726059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:26.732730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:26.733187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:26.733963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:26.734427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:26.762328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9cb8affc-efe5-4b4c-b644-c56167ab3312 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 May 05 14:13:26.762827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 717/1740] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:27.773602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:27.774539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:27.780821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:27.781273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:27.782198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:27.782656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:27.810572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4708947c-b247-441d-ab6f-e2f5e496ce05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041621 May 05 14:13:27.811134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1024/1741] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:28.822239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:28.823125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:28.829393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:28.829853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:28.830669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:28.831111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:28.861250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-68b35b72-f338-47c2-a51b-8de6a680f6af tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 May 05 14:13:28.861820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 718/1742] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:29.872857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:29.873872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:29.880003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:29.880981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:29.881751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:29.882220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:29.911545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75aa9cad-0c02-49e7-9d6b-8777e648f584 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 May 05 14:13:29.912137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1025/1743] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:30.923548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:30.924477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:30.931486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:30.931940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:30.932707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:30.933147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:30.962755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c481e406-feb5-492f-b77a-841b953d4182 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 May 05 14:13:30.963419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 719/1744] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:31.975002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:31.975938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:31.982600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:31.983057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:31.983839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:31.984283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:32.012571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3cfcc463-5cd3-4949-9a86-c0878e04d8fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042182 May 05 14:13:32.013132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1026/1745] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:33.024864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:33.025797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:33.032206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:33.032660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:33.033433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:33.033876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:33.063123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec966efb-1488-4af5-9678-ba83137febbf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 May 05 14:13:33.063695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 720/1746] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:34.074980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:34.075959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:34.082372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:34.082826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:34.083637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:34.083997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:34.112947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-be5a3876-0b75-423b-bd35-89ff3a485b0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041844 May 05 14:13:34.113501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1027/1747] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:35.124862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:35.125793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:35.132841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:35.133293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:35.134082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:35.134521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:35.163932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d623487f-e4a8-443a-bfc1-809183a1bb04 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043007 May 05 14:13:35.164693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 721/1748] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:36.175488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:36.176576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:36.183574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:36.184020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:36.185098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:36.185530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:36.214653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2b6360cc-d679-4aa1-83ff-b65b237ffffd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 May 05 14:13:36.215208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1028/1749] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:37.227519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:37.228451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:37.235053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:37.235506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:37.236285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:37.236724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:37.266326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c4384cd0-071b-4cac-9680-f0d280bf1d03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 May 05 14:13:37.266889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 722/1750] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:38.277083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:38.278706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:38.285661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:38.286140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:38.286899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:38.287332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:38.316562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-95bd2383-0f01-4b50-95f1-727541523191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 May 05 14:13:38.317129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1029/1751] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:39.328704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:39.329670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:39.336510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:39.336962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:39.337724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:39.338195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:39.367095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-93361422-5391-48cb-932b-ba1f26fe6062 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042329 May 05 14:13:39.367645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 723/1752] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:13:40.378722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:40.379639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:40.385931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:40.386485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:40.387244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:40.387679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:40.417445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f54427a-0af8-4bb8-a814-43e61d4e631d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 May 05 14:13:40.418004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1030/1753] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:41.428779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:41.430226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:41.436524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:41.436968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:41.437726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:41.438200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:41.467102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0ab266b-bc7a-4cda-8e1e-69848cf29859 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 May 05 14:13:41.467959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 724/1754] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:42.479253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:42.480178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:42.486810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:42.487439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:42.488215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:42.488656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:42.516989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-317a5256-a362-430e-bf97-0ca739254689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 May 05 14:13:42.517556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1031/1755] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:43.529027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:43.529947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:43.536251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:43.536732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:43.537488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:43.537921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:43.566063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dfe61d12-677d-447d-9b66-b237830d993c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040929 May 05 14:13:43.566634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 725/1756] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:44.577455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:44.578482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:44.584793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:44.585248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:44.586525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:44.586963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:44.616254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4f88592-8f3f-4047-9570-cdb21906cdae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042679 May 05 14:13:44.616995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1032/1757] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:45.627637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:45.628562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:45.634978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:45.635423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:45.636181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:45.636614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:45.666141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1a520579-c22f-4c23-b0fb-8b7d341bbab0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042328 May 05 14:13:45.666712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 726/1758] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:46.677636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:46.678592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:46.685368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:46.685815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:46.686608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:46.687042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:46.715781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53cd99f0-6a76-4a7f-bc63-ffd0f0751a31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041990 May 05 14:13:46.716575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1033/1759] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:47.728221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:47.729147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:47.735487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:47.735953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:47.736699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:47.737133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:47.765221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0634d87-ac4d-4b83-966a-926c7e938d58 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041847 May 05 14:13:47.765782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 727/1760] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:48.777032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:48.777888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:48.784275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:48.784728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:48.785548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:48.785993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:48.982246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2840a12a-9384-4cdb-8043-a1c29f2eae2e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 May 05 14:13:48.982246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1034/1761] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:49.829999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:49.830953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:49.836864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:49.837316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:49.838109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:49.838547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:49.866514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a7a40cb-fe71-4b34-a52c-309fec04b631 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040606 May 05 14:13:49.867149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 728/1762] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:50.878653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:50.879612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:50.885915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:50.886402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:50.887164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:50.887602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:50.916005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-74eea29c-4701-4554-9e7f-6f60f6da6b75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041276 May 05 14:13:50.921803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1035/1763] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:51.931489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:51.932446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:51.938774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:51.939216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:51.939974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:51.940403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:51.968383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0cf84bd5-6c9c-48d2-982b-af7976a8469e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040855 May 05 14:13:51.968919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 729/1764] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:52.980557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:52.985889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:52.987786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:52.988242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:52.989002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:52.989438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:53.018448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56cf22da-da76-47ab-a9b9-3b3fc6cf0b49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042148 May 05 14:13:53.018989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1036/1765] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:54.030127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:54.030988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:54.037422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:54.037874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:54.038679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:54.039123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:54.068089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8abe8c18-4c44-4b24-b1f3-4725369888b1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042004 May 05 14:13:54.068632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 730/1766] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:55.079546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:55.080469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:55.086814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:55.087264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:55.088030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:55.088467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:55.118420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-baf71165-ca1b-4008-8a8d-f244fa9d842c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 May 05 14:13:55.118972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1037/1767] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:56.129843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:56.130805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:56.137658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:56.138153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:56.138922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:56.139361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:56.167684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0ee29dbc-34e2-47c3-833a-316bb2bbd1fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041779 May 05 14:13:56.168219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 731/1768] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:57.179110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:57.180029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:57.186406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:57.186858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:57.187620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:57.188057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:57.216345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8ae28650-936a-4224-93e9-514f2422da51 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 May 05 14:13:57.216890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1038/1769] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:58.228671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:58.229622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:58.235904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:58.236354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:58.237109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:58.237547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:58.265483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3dacea05-2079-4280-938a-bfcf20142842 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 May 05 14:13:58.266009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 732/1770] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:13:59.276812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:13:59.277733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:13:59.283784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:59.284267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:59.285027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:13:59.285459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:13:59.314863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f505dbdb-5467-442b-bcc8-bd322ed20689 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 May 05 14:13:59.315406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1039/1771] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:13:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:00.327196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:00.328174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:00.334567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:00.335023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:00.335790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:00.336230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:00.364087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-976f979e-56fa-410c-8284-a66d7491f0de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 May 05 14:14:00.364668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 733/1772] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:14:01.375826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:01.376745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:01.383741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:01.384276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:01.385044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:01.385481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:01.413895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-217ec512-1f29-479e-9f29-f996932cda7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041997 May 05 14:14:01.414508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1040/1773] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:02.425910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:02.426868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:02.433711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:02.434259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:02.435028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:02.435465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:02.463649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e6812c69-81a2-487a-8dea-09c145e2d282 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041671 May 05 14:14:02.464191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 734/1774] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:03.475145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:03.476063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:03.483406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:03.483851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:03.484600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:03.485033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:03.513887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7363445b-f3c2-4f43-b079-ffb9116fed39 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 May 05 14:14:03.514474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1041/1775] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:04.524825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:04.525662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:04.531964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:04.532411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:04.533169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:04.533602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:04.562757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bb027631-b3af-45cf-bdc9-17646f1c7343 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041902 May 05 14:14:04.563306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 735/1776] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:05.574291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:05.575227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:05.581638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:05.582128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:05.582900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:05.583345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:05.611696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b6b04c1a-ca0a-4a9f-815f-c77b12ae4e23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042007 May 05 14:14:05.612239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1042/1777] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:06.623431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:06.624398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:06.630841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:06.631287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:06.632192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:06.632623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:06.661604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c27046a-c387-4a1d-aa1a-86ca0c742683 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 May 05 14:14:06.662166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 736/1778] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:07.673180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:07.674289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:07.680821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:07.681271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:07.682123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:07.682570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:07.714423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-01dc6448-9559-47c0-93c5-e5b5a86bb3b9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 May 05 14:14:07.715058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1043/1779] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:08.725766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:08.726742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:08.733391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:08.733842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:08.734643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:08.735089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:08.765457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e51cefc6-0037-4f7c-8e94-330f546d198a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 May 05 14:14:08.772516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 737/1780] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:09.782241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:09.783099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:09.789520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:09.789980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:09.790781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:09.791228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:09.819168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e0be6054-9c72-426d-a76e-e586dc8b0d87 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041045 May 05 14:14:09.819710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1044/1781] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:10.831336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:10.832303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:10.839181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:10.839641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:10.840412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:10.840856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:10.869507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-89acc3b2-3c83-425b-9cbc-2356eb14c908 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042162 May 05 14:14:10.870067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 738/1782] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:11.880953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:11.881881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:11.888264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:11.888712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:11.889463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:11.889896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:11.917835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8031c178-851d-4adc-8062-8c629331cd95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040854 May 05 14:14:11.918398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1045/1783] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:12.929004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:12.930462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:12.936723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:12.937176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:12.937936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:12.938398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:12.966601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8885d7e8-876a-418a-9999-801a498ca1d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 May 05 14:14:12.967146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 739/1784] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:13.978467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:13.979337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:13.985610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:13.986109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:13.986881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:13.987314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:14.016141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-20ed6142-b4e7-4937-b1e2-d326a503ba59 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042048 May 05 14:14:14.016680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1046/1785] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:15.028037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:15.028968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:15.035357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:15.035811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:15.036577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:15.037023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:15.065715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4435cb45-e6a7-4c3a-bcbb-07c8851515ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 May 05 14:14:15.066282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 740/1786] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:16.077716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:16.078702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:16.084990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:16.085439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:16.086247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:16.086684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:16.115451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-894846f2-9015-4ade-8bab-e7a79b5e30bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041625 May 05 14:14:16.115983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1047/1787] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:17.127452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:17.128390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:17.135316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:17.135773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:17.136546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:17.136990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:17.165495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6881aabc-add1-49d9-920c-6d3b9e76dd07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 May 05 14:14:17.166053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 741/1788] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:14:18.176968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:18.177932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:18.184436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:18.184893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:18.185666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:18.186143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:18.214186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fccb9e0f-5c5e-4950-9dbb-0edd59d77b0e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041145 May 05 14:14:18.214725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1048/1789] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:19.225825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:19.226782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:19.234093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:19.234494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:19.235262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:19.235705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:19.263768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-640e5f6a-3fd4-461d-8bb4-d417d29aefff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 May 05 14:14:19.264305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 742/1790] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:20.275413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:20.276269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:20.282640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:20.283095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:20.283862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:20.284304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:20.313131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2d2448b-7e72-4eee-8d06-1638ad8e6dac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 May 05 14:14:20.313673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1049/1791] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:21.324820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:21.325755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:21.331565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:21.332017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:21.332779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:21.333217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:21.363186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8b3506c7-590b-4fd1-8180-cfd1cbaff613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 May 05 14:14:21.363747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 743/1792] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:22.375228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:22.376154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:22.382511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:22.382961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:22.383722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:22.384158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:22.411822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb2b69f2-0098-43db-babd-a7031d804f83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040573 May 05 14:14:22.412373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1050/1793] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:23.423924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:23.424853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:23.431673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:23.432148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:23.432914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:23.433352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:23.461495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-898fd5d6-b578-4c11-af73-72e1e2e204bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 May 05 14:14:23.462064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 744/1794] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:24.473049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:24.473897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:24.481085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:24.481536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:24.482396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:24.482837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:24.512140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3d5c89f1-2710-4264-976e-78a6d329befc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 May 05 14:14:24.512695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1051/1795] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:25.523853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:25.524683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:25.531417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:25.531872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:25.532678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:25.533123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:25.562316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7b24ff7d-b507-4949-918a-4a97d0cc56c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 May 05 14:14:25.562858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 745/1796] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:26.574000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:26.574873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:26.581128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:26.581572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:26.582350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:26.582786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:26.612718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f6b7b521-a9d4-42b1-a33c-610aafba7c1e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 May 05 14:14:26.613262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1052/1797] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:27.624175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:27.625099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:27.631635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:27.632082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:27.632840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:27.633276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:27.661556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67cfa731-d2f6-47c7-a4dd-d0be3ae7c613 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 May 05 14:14:27.662122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 746/1798] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:28.672687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:28.673615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:28.679640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:28.680090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:28.680850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:28.681291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:28.873443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56b19d8f-249e-41ba-81f2-a3e1c147fc5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204522 May 05 14:14:28.873959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1053/1799] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:29.884551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:29.885472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:29.891746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:29.892194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:29.892950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:29.893382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:29.921237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-07691142-9870-420d-a61d-4326217ee079 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040574 May 05 14:14:29.921774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 747/1800] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:30.931934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:30.932866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:30.939111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:30.939559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:30.940315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:30.940748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:30.970705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84a639ab-08c0-4480-88b4-9d6c39be7505 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042677 May 05 14:14:30.971240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1054/1801] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:31.982603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:31.983528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:31.989903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:31.990398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:31.991170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:31.991608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:32.021061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5568d53a-b720-475f-9e94-6c9ecd92a216 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 May 05 14:14:32.021618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 748/1802] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:14:33.032514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:33.033443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:33.039998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:33.040453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:33.041723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:33.042195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:33.070888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b068f4d3-d7f8-4276-a924-378716e233b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042258 May 05 14:14:33.071424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1055/1803] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:34.081928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:34.082882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:34.089091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:34.089608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:34.090409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:34.090848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:34.119243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8cbf3505-036a-4362-a035-1ff3f40458b2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041205 May 05 14:14:34.119790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 749/1804] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:35.131210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:35.132155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:35.139052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:35.139517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:35.140289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:35.140739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:35.169914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7bd46740-9413-4072-a899-13eaa31fc797 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042610 May 05 14:14:35.170574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1056/1805] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:36.181134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:36.182068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:36.188413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:36.188866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:36.189632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:36.190096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:36.218432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e432eea9-2cc3-4b1b-bc2f-4441d179f432 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 May 05 14:14:36.218971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 750/1806] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:37.231289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:37.232276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:37.238642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:37.239103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:37.239868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:37.240311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:37.268744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e559a0ee-cd8d-44ec-8858-7aa2c52adf90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 May 05 14:14:37.269293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1057/1807] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:38.280888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:38.281818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:38.288254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:38.288707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:38.289475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:38.289913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:38.318168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6f2727a2-187c-483e-b089-83db91b4f71f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041853 May 05 14:14:38.318706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 751/1808] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:39.328790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:39.329750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:39.336047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:39.336498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:39.337256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:39.337689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:39.367002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ff1c7497-8b95-4229-8335-675f1b4a3843 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 May 05 14:14:39.367468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1058/1809] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:14:40.378364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:40.379288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:40.385582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:40.386056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:40.386819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:40.387259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:40.417955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92002e4f-c350-4d51-92eb-87da7f24c0f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 May 05 14:14:40.418598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 752/1810] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:41.430117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:41.431079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:41.437546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:41.438149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:41.438894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:41.439310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:41.469663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41932567-c009-4dad-8676-3c5600965ced tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043503 May 05 14:14:41.470253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1059/1811] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:42.481028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:42.482520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:42.488754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:42.489209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:42.489982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:42.490486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:42.519161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e108a3ee-ce4e-4162-bdc4-de95cad9416e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 May 05 14:14:42.519701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 753/1812] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:43.530496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:43.531422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:43.537660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:43.538145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:43.538902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:43.539335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:43.567846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a55f98d3-8fe0-408e-8bf7-87677676c651 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041304 May 05 14:14:43.568374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1060/1813] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:44.579813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:44.580740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:44.586962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:44.587414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:44.588178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:44.588613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:44.617450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b13622d0-8ccb-43c2-8dd9-7fa5f42b8844 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 May 05 14:14:44.618003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 754/1814] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:45.628595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:45.629640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:45.635930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:45.636417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:45.637191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:45.637658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:45.666843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83e19c55-be44-424c-9d53-d627074cdb81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 May 05 14:14:45.667380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1061/1815] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:46.678249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:46.679179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:46.685599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:46.686086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:46.686878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:46.687323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:46.716518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-57a98be8-3fee-4867-befd-49ea6c8e786b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 May 05 14:14:46.717059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 755/1816] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:47.728216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:47.729146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:47.735404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:47.735859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:47.736614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:47.737049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:47.765709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac4acf4b-3b04-47ed-87a8-3ff30a15d191 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041653 May 05 14:14:47.766276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1062/1817] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:48.776737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:48.777668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:48.786333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:48.786795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:48.787580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:48.788022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:48.823152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1a3d4734-d583-44f3-9452-742551b956c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 May 05 14:14:48.823152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 756/1818] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:49.832582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:49.833517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:49.839996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:49.840467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:49.841775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:49.842353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:49.871568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a13ebc2-6ec7-416d-bae5-d07ca2796e35 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 May 05 14:14:49.872111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1063/1819] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:50.882999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:50.883934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:50.889762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:50.890252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:50.891062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:50.891510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:50.920543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-36f6a43d-dae5-48f2-9edc-5ccc9f9dc6a7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 May 05 14:14:50.921081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 757/1820] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:51.931948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:51.932905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:51.939756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:51.940211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:51.941010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:51.941449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:51.971408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2a14334c-91c9-47c2-ad49-abc69b73b003 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 May 05 14:14:51.971953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1064/1821] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:52.982993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:52.984018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:52.990273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:52.991077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:52.991859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:52.992339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:53.021272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-638d01e2-4b1d-45c6-89a4-2a18be9d7254 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042107 May 05 14:14:53.021820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 758/1822] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:54.032806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:54.033739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:54.040103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:54.040558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:54.041327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:54.041770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:54.071208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3469fd3c-7b24-4df0-9398-9b44b4db82e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042760 May 05 14:14:54.071760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1065/1823] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:55.082168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:55.083123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:55.089361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:55.089814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:55.090624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:55.091065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:55.121437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bd0617dc-abc3-4ca7-9ae4-bc0a0786707b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 May 05 14:14:55.122037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 759/1824] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:56.132724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:56.133652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:56.139915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:56.140362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:56.141120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:56.141558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:56.169779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e754779-2778-4a8a-860d-2a0a8e7f65d7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 May 05 14:14:56.170343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1066/1825] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:57.180640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:57.181564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:57.188416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:57.188866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:57.189648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:57.190109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:57.219508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-345f65d5-f696-4935-8877-6f8402c822ce tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 May 05 14:14:57.220056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 760/1826] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:58.231304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:58.232242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:58.238314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:58.238769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:58.239538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:58.239980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:58.268445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-edd76a85-530d-4dd1-a584-afd3bf4f44c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041351 May 05 14:14:58.268985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1067/1827] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:14:59.280217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:14:59.281157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:14:59.287534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:59.287990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:59.288765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:14:59.289208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:14:59.318147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ef433b57-88e9-4e9c-9fda-c0b58ccfd890 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 May 05 14:14:59.318698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 761/1828] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:14:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:00.330361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:00.331294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:00.337841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:00.338465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:00.339247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:00.339692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:00.369191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b811b8e-483f-4f06-b7a1-84db9f587ad5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 May 05 14:15:00.369741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1068/1829] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:01.385051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:01.386037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:01.392312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:01.392759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:01.393528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:01.393964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:01.429299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fc5ac6a6-0b87-41a9-9612-ccd786fc26c0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048961 May 05 14:15:01.429889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 762/1830] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:02.440520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:02.441475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:02.447803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:02.448246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:02.449008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:02.449440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:02.478468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-442ad2a8-322b-4a40-9488-4e83c6c33339 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042291 May 05 14:15:02.479015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1069/1831] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:03.489631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:03.490589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:03.496976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:03.497511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:03.498321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:03.498767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:03.527415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b08638bd-64d5-4dd0-9145-6d46a6fc393c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041748 May 05 14:15:03.531946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 763/1832] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:04.539533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:04.540541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:04.547492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:04.547942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:04.548712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:04.549151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:04.578490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0043417c-b7cc-4d1e-b6d8-0cac3ec0e7aa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 May 05 14:15:04.579270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1070/1833] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:05.590391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:05.591361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:05.597712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:05.598208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:05.599006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:05.599446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:05.629895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c054d2f1-3ea2-49fc-828c-5fc35857d9d8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 May 05 14:15:05.630502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 764/1834] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:06.641818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:06.642782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:06.649157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:06.649605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:06.650430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:06.650877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:06.680984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-770cdf4e-1a69-44b4-9fbd-3eefadaefb77 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 May 05 14:15:06.682177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1071/1835] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:07.692780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:07.693728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:07.700137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:07.700584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:07.701350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:07.701994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:07.731056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8349bd0a-e6b1-4433-ad6f-4a5849b88011 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 May 05 14:15:07.731605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 765/1836] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:08.742883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:08.743803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:08.750207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:08.750657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:08.751396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:08.751834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:08.781446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b326c7e-571b-462c-b581-98ad8e376354 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042489 May 05 14:15:08.782003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1072/1837] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:09.792871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:09.793792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:09.800542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:09.800997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:09.801897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:09.802243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:09.831746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-38c4a5da-6d67-49be-ae90-5581851a68bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 May 05 14:15:09.832296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 766/1838] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:10.523080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:10.523661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:10.532657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.533116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.534883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.536368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.566507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:15:10.796959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b999cd32-e83b-4bab-b4ee-1cf35e7e38c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 204 len: 0 microversion: 2.1 time: 0.277448 May 05 14:15:10.797479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1073/1839] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:15:10 2022] DELETE /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:15:10.805423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:10.806061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:10.812380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.812833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.813605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.814071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.844538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:10.845555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:10.851816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.856899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.856899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:10.856899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:10.885944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b8fb0be-e59f-4981-97f0-871660d44764 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 May 05 14:15:10.886735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1074/1840] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:10.946714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:10.955310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9cf44d11-21c0-4383-a976-38e1169bac44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153629 May 05 14:15:10.965012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 767/1841] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:11.897373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:11.898334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:11.905344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:11.905798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:11.906744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:11.907193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:11.938785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7daca2f8-d4e6-4217-aac6-1de0d875248a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 May 05 14:15:11.939348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1075/1842] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:11.972412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:11.973136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:11.979657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:11.980106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:11.980872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:11.981308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:12.117313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:12.125073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-411755c1-8401-4d2c-8c83-1121e6faff03 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.156403 May 05 14:15:12.125639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 768/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:12.950470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:12.952007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:12.958297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:12.958752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:12.959515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:12.960184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:12.991598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-191844dc-2755-439a-84dd-cd286e50417f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 May 05 14:15:12.992297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1076/1844] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:13.141675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:13.142298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:13.148649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:13.149134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:13.149906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:13.150375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:13.278851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:13.286528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-087895af-0926-42a2-a5c6-e57237f90945 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148656 May 05 14:15:13.287108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 769/1845] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:14.003818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:14.004755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:14.011082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:14.011542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:14.012307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:14.012747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:14.040906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-23f63857-5a31-40a7-b92f-623ba6566e6b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 May 05 14:15:14.041458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1077/1846] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:14.302852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:14.303457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:14.309690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:14.310182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:14.310967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:14.311411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:14.434392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:14.442308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-562b10c3-2a3d-431e-8782-1c3a4bde1557 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143172 May 05 14:15:14.442881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 770/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:15.052455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:15.053378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:15.059740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:15.060201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:15.061482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:15.061926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:15.090773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65c6cb6b-e895-4067-a090-6b98008ee6dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 May 05 14:15:15.091343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1078/1848] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:15.459100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:15.459737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:15.466260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:15.466719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:15.467490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:15.467932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:15.592473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:15.600215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-42725176-1237-4057-af16-cc0e7f3a9dac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145000 May 05 14:15:15.600813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 771/1849] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:16.102007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:16.103226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:16.110192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:16.110651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:16.111418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:16.111861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:16.143574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c67ed9f2-d8c0-4771-aa9c-465ae71161db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 May 05 14:15:16.144130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1079/1850] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:16.617604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:16.618241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:16.624583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:16.625028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:16.625788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:16.626249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:16.753244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:16.761041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6bff285c-339a-43b9-8148-b7d863702fcf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147203 May 05 14:15:16.761610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 772/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:17.154172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:17.159305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:17.162108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:17.162836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:17.163349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:17.163799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:17.197861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-173936d0-66b9-4ed8-b0fe-002e54bdd3ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047617 May 05 14:15:17.198453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1080/1852] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:17.777819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:17.778443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:17.785437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:17.785889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:17.786688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:17.787128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:17.909888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:17.917632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d98075c1-4c80-4530-abd2-df141baf153d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143687 May 05 14:15:17.918227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 773/1853] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:18.210005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:18.210961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:18.217854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:18.218355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:18.219092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:18.219534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:18.252161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a7a7532-7dd7-4c8e-9e11-376a89d0c85e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 May 05 14:15:18.252715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1081/1854] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:18.934529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:18.935139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:18.941907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:18.942468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:18.943222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:18.943655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:19.070285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:19.078593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f427c653-6ce2-4ec9-b161-64f118a87d45 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147926 May 05 14:15:19.079158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 774/1855] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:19.263740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:19.264610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:19.270978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:19.271428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:19.272194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:19.272633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:19.302209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bee168fe-50e2-47a3-9f48-c5634dcc7bdd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042419 May 05 14:15:19.302772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1082/1856] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:20.096133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:20.096782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:20.103014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:20.103464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:20.104230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:20.104703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:20.229941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:20.237733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b561c016-ecc4-4567-817a-33337f733139 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146275 May 05 14:15:20.238334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 775/1857] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:20.314280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:20.315305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:20.321677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:20.322166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:20.322934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:20.323518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:20.353993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-436b80cf-eecd-4e98-8e47-95c85156905f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 May 05 14:15:20.354580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1083/1858] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:21.254710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:21.255219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:21.261515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:21.261969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:21.262768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:21.263215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:21.370947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:21.371880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:21.378889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:21.379343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:21.380122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:21.381126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:21.389334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:21.397802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3c2a7442-8298-4cd1-ab8a-975a4648bc74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146950 May 05 14:15:21.398812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 776/1859] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:21.410637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46abec04-7410-4584-9093-e21b7a9efa50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 May 05 14:15:21.411205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1084/1860] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:22.415311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:22.415870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:22.421903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:22.422416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:22.422784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:22.422903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:22.423564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:22.423999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:22.429392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:22.429842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:22.430655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:22.431094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:22.466220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6999072-5b28-4e0e-9e0a-9a6db0f712b4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 May 05 14:15:22.466841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1085/1861] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:22.560275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:22.569262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-78fee06e-5d9d-4574-b986-392dc6ad6ada tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.157924 May 05 14:15:22.569827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 777/1862] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:23.478624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:23.479545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:23.486553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:23.487001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:23.487751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:23.488187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:23.516158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-910abb13-ce4b-4515-b00e-c3ea006d3884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 May 05 14:15:23.516707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1086/1863] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:23.585934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:23.586755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:23.594388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:23.594845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:23.595648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:23.596092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:23.728997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:23.736687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a3f0cf8d-e880-446f-a3e0-d4922f353615 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154701 May 05 14:15:23.737240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 778/1864] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:24.527656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:24.528544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:24.535448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:24.535894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:24.536728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:24.537164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:24.568738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69825767-c224-4a26-82d7-18c00a9771f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 May 05 14:15:24.569468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1087/1865] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:24.754769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:24.755390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:24.761789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:24.762274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:24.763058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:24.763502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:24.919108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:24.927058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26dfc181-a8d7-44fb-942b-41044c74e3a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.176166 May 05 14:15:24.927631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 779/1866] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:25.580803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:25.581731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:25.588122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:25.588567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:25.589322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:25.589759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:25.619097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-044f4501-c045-4123-83a5-3c2a2559d6c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 May 05 14:15:25.619631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1088/1867] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:25.944444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:25.945054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:25.951858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:25.952309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:25.953069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:25.953503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:26.075516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:26.083669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9f40b72e-62f9-4a59-847f-ce5e4fc6f05e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143101 May 05 14:15:26.084236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 780/1868] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:26.630659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:26.631590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:26.637911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:26.638397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:26.639670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:26.640143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:26.667945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-36b5d955-4bb5-4efb-9eb9-bc38177ee8d6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041295 May 05 14:15:26.668485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1089/1869] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:27.101164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:27.101973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:27.109083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:27.109539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:27.110336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:27.110774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:27.239951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:27.247684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cdf9816d-61fe-410c-b0ca-85bab7e2ca93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150460 May 05 14:15:27.248251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 781/1870] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:27.678547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:27.679467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:27.686288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:27.686736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:27.687494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:27.687926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:27.717215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c33f7bbf-f39f-48ee-9bec-f471daa4a1e3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042215 May 05 14:15:27.717752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1090/1871] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:28.265125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:28.265676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:28.272057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:28.272508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:28.273266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:28.273702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:28.397936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:28.405805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-706998e7-0657-45a4-a0f0-c4e2a9805703 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145145 May 05 14:15:28.406408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 782/1872] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:28.728417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:28.729354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:28.736066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:28.736526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:28.737293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:28.737741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:28.766251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b1250f5-0f2c-4c19-92b0-c6120bf2d8d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042038 May 05 14:15:28.781066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1091/1873] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:29.423202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:29.423818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:29.430147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:29.430597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:29.431360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:29.431806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:29.554950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:29.562840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1c21f71c-529f-4c5a-9fde-712d458b72e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144100 May 05 14:15:29.563407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 783/1874] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:29.790959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:29.791815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:29.798134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:29.798594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:29.799368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:29.799810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:29.828001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eff81661-da3d-4019-bbd1-7114cbfb29a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 May 05 14:15:29.828547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1092/1875] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:30.579845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:30.580466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:30.587059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:30.587501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:30.588267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:30.588711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:30.720068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:30.728268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9965ab01-7cd4-4029-a9fb-f96c325caec6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152546 May 05 14:15:30.728837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 784/1876] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:30.839406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:30.840307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:30.846627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:30.847080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:30.847846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:30.848289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:30.877495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f5b30260-2e3d-458a-92ea-d536a38ba69b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042096 May 05 14:15:30.878075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1093/1877] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:31.745026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:31.745647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:31.752043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:31.752499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:31.753266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:31.753705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:31.880499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:31.888902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c95ff6b-872c-45ae-8529-66af2d3d2458 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147557 May 05 14:15:31.889113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:31.889585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 785/1878] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:31.890088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:31.896386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:31.896842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:31.897618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:31.898102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:31.926462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6397a07a-49e6-44ca-9058-85e60558272c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 May 05 14:15:31.927003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1094/1879] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:32.905909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:32.906558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:32.912924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:32.913359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:32.914150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:32.914595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:32.938480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:32.939436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:32.945728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:32.946221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:32.946993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:32.947431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:32.977248 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c1d0d32-8d1a-4dd3-97b0-235772196347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 May 05 14:15:32.981495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1095/1880] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:33.045648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:33.053454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4ba9304c-c285-4c20-b362-56cb929f3586 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151467 May 05 14:15:33.054047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 786/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:33.989481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:33.990496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:33.996845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:33.997307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:33.998102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:33.998548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:34.026355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fdcf20c8-1b29-482a-bc46-e5be59d75b32 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040855 May 05 14:15:34.026899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1096/1882] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:34.070234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:34.070848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:34.077712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:34.078188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:34.078953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:34.079393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:34.203943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:34.211741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b631a992-c128-4ed1-b18b-8f459925f311 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145309 May 05 14:15:34.212307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 787/1883] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:35.037903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:35.038906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:35.045690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:35.046175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:35.046942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:35.047380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:35.075541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a8256a56-7895-4b21-886e-ca631fd22b29 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041619 May 05 14:15:35.076083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1097/1884] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:35.228864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:35.229474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:35.236534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:35.236980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:35.237739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:35.238199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:35.367678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:35.379217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-380b6fc8-3f43-423b-a5e4-4e51860b663a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154412 May 05 14:15:35.379794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 788/1885] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:36.087039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:36.087971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:36.094375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:36.094830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:36.095606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:36.096050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:36.124965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d1c4d74-3aed-4f1a-9e20-0bd35e77a9b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 May 05 14:15:36.125511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1098/1886] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:36.399845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:36.401053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:36.407776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:36.408267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:36.409153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:36.409595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:36.615981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:36.624824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3d3cfad2-7337-491b-b75c-9d005e113359 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.231991 May 05 14:15:36.625473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 789/1887] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:37.136785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:37.137639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:37.144496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:37.144951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:37.145717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:37.146193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:37.174983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b2cc887d-3697-419a-9df7-39ec7a703d5d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042381 May 05 14:15:37.175527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1099/1888] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:37.642259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:37.642874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:37.649265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:37.649667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:37.650480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:37.650928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:37.785411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:37.793225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3177921f-2f5f-4749-9588-4e20e761a8e6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.155472 May 05 14:15:37.793795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 790/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:38.187448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:38.188406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:38.194720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:38.195170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:38.195922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:38.196356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:38.224504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc495f90-be9a-4884-861e-6dbbf76ca853 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041997 May 05 14:15:38.225037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1100/1890] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:38.810310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:38.810856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:38.817093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:38.817543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:38.818346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:38.818788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:38.949540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:38.957842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-178ba71b-d8ff-4bd4-ad62-331a6dad5288 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151582 May 05 14:15:38.958437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 791/1891] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:39.236177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:39.237114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:39.243437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:39.243894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:39.244662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:39.245107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:39.272800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6b32fb62-0112-4b72-a3c2-a46b4285d297 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 May 05 14:15:39.273339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1101/1892] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:39.974973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:39.975628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:39.982816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:39.983270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:39.984038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:39.984475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:40.112568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:40.120376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2e9dd5c6-cea6-42a8-95a8-928df50d044a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149300 May 05 14:15:40.120946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 792/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:40.284430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:40.285396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:40.291760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:40.292213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:40.292977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:40.293416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:40.322837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b2c61a8-177f-4f1d-8e79-fa51bc32113c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042452 May 05 14:15:40.323582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1102/1894] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:41.139283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:41.140611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:41.147224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:41.147758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:41.148624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:41.149133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:41.283974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:41.292044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5f0cb75-45be-4408-b156-099de463c951 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.157237 May 05 14:15:41.292720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 793/1895] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:41.334125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:41.335050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:41.341547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:41.341990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:41.342940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:41.343606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:41.371987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0651c816-8deb-4b34-9a65-cd0ac3e7d347 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 May 05 14:15:41.373227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1103/1896] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:42.309293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:42.309909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:42.316380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:42.316830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:42.317619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:42.318077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:42.384208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:42.385054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:42.392066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:42.392516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:42.393282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:42.393719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:42.422957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2d21e80e-3378-40bf-b20d-a220d63165da tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042678 May 05 14:15:42.423511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1104/1897] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:42.446041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:42.454517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a67f0c9-840c-42ff-a8d2-9aaddad8fb9f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149179 May 05 14:15:42.455087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 794/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:43.434855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:43.435787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:43.442164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:43.442619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:43.443383 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:43.443823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:43.471563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:43.472171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:43.473043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-34071454-226e-41e7-8f0f-c2a2e84912a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042140 May 05 14:15:43.473669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1105/1899] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:43.478776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:43.479221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:43.479985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:43.480416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:43.606488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:43.614234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-10d7b04d-545b-4ced-9332-8e0b5cb7f140 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146433 May 05 14:15:43.614797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 795/1900] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:15:44.484927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:44.485800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:44.492084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:44.492533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:44.493313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:44.493747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:44.522357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05d5c411-a50d-426a-b7c9-54da2dcc8884 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041452 May 05 14:15:44.522900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1106/1901] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:44.630589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:44.631240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:44.637663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:44.638164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:44.638941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:44.639382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:44.767015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:44.774847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a18df63f-fbbc-4bb3-8e30-73d1c7dcfdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148097 May 05 14:15:44.775417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 796/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:45.534540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:45.535467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:45.541774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:45.542261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:45.554118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:45.554118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:45.571502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-71784190-5993-48d0-b9c0-c429ad6ffcaa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041173 May 05 14:15:45.572047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1107/1903] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:45.791209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:45.791972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:45.798457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:45.798918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:45.799749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:45.800197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:45.928173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:45.936494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-29a446f8-0c66-49b6-b19c-a6b53201da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149077 May 05 14:15:45.937058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 797/1904] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:46.582948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:46.583870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:46.590284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:46.590735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:46.591996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:46.592432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:46.620755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e3bf4d11-be58-473f-a2bf-9a3825d75ca6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 May 05 14:15:46.621291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1108/1905] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:46.953151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:46.953768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:46.960073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:46.960525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:46.961297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:46.961736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:47.091197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:47.102283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-392f88c8-eac1-4442-8fc1-11390f287f52 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150331 May 05 14:15:47.102283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 798/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:47.632445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:47.633377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:47.640286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:47.640733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:47.641489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:47.641920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:47.670278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a00de076-ddfe-44a8-b5c4-5c80980590ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041767 May 05 14:15:47.670835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1109/1907] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:48.115989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:48.116610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:48.123529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:48.123982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:48.124761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:48.125202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:48.249760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:48.261749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c934b7e-a1aa-4f29-95c7-838c2a9eaeab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149601 May 05 14:15:48.262370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 799/1908] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:48.680908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:48.681869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:48.688188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:48.688637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:48.689400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:48.689835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:48.726765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7788bc48-c762-43d4-9985-307359bf4ea4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049878 May 05 14:15:48.727318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1110/1909] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:49.279803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:49.280368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:49.286698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:49.287146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:49.287905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:49.288335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:49.415461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:49.423231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eb4cbf4c-1d2d-48fc-9c8c-2595075d11c8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147976 May 05 14:15:49.423792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 800/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:49.739004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:49.739967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:49.746233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:49.746683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:49.747438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:49.747874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:49.775292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7874f406-ea8a-4b49-aca4-7f78476d091f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040255 May 05 14:15:49.775830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1111/1911] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:50.440517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:50.441152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:50.447160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:50.447610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:50.448365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:50.448796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:50.577415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:50.585222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c34cb333-b8da-422d-a32f-cd10c8aed119 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148608 May 05 14:15:50.585793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 801/1912] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:50.787400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:50.788241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:50.795128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:50.795573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:50.796328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:50.796762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:50.824967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-60da199b-ea51-47f9-a774-8dbefeff1acb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041668 May 05 14:15:50.826037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1112/1913] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:51.601990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:51.602653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:51.609697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:51.610177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:51.610942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:51.611383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:51.744108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:51.751924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-96f010cc-1ba7-47c4-9964-c8e4b9e832b6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153802 May 05 14:15:51.752491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 802/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:51.836428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:51.837358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:51.844262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:51.844718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:51.845484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:51.845926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:51.874458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c60dbec6-cd9f-4fca-a8c3-31eb9d40f2f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 May 05 14:15:51.874948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1113/1915] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:52.768768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:52.769389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:52.775772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:52.776220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:52.776988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:52.777424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:52.885941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:52.886895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:52.893754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:52.897523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:52.897523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:52.897523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:52.906666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:52.915362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67e26e98-a139-4ade-bbd9-2142d16632f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150402 May 05 14:15:52.916149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 803/1916] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:52.926039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24700345-bb49-4c0d-a7c6-1cd72223ae5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 May 05 14:15:52.926597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1114/1917] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:53.932463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:53.933077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:53.937545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:53.938493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:53.940077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:53.940541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:53.941290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:53.941727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:53.944813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:53.945259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:53.946042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:53.946468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:53.975657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a531d0d-fa40-4fb0-9281-69fb1fdc9c41 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 May 05 14:15:53.976218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1115/1918] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:15:54.069959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:54.078346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1470f4d7-6cfb-4f30-b45c-d976e5ca0f44 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149722 May 05 14:15:54.078918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 804/1919] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:54.987476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:54.988405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:54.994761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:54.995212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:54.995976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:54.996418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:55.030402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b38be73-aead-4d5c-b07c-d78c083fc8b6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 May 05 14:15:55.030972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1116/1920] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:55.095148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:55.095763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:55.102126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:55.102588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:55.103611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:55.104041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:55.232748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:55.241019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-722f9586-a901-4ffb-bc2b-a635ea2c1eec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149571 May 05 14:15:55.241525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 805/1921] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:56.041949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:56.042914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:56.049189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:56.049657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:56.050425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:56.050870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:56.079122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ea3dba06-9c41-401e-8ac8-f733459b8881 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041158 May 05 14:15:56.079659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1117/1922] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:56.258657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:56.259273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:56.266237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:56.266693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:56.267463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:56.267902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:56.393487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:56.401567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5f689aab-7f7e-4e5c-9fe9-adef8f1bd7c3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146764 May 05 14:15:56.402148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 806/1923] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:57.090242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:57.091719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:57.098265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:57.098723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:57.099495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:57.099935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:57.129541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-19ee1440-613b-4162-a2ff-318c16ab4927 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043260 May 05 14:15:57.130123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1118/1924] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:57.418242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:57.418923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:57.425395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:57.425849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:57.426686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:57.427109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:57.555769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:57.563489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1bea7629-da67-4855-a517-9ee990be0976 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149121 May 05 14:15:57.564051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 807/1925] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:58.140487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:58.141430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:58.147431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:58.147891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:58.148658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:58.149109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:58.177345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7d98f325-38d7-450e-a763-d09960e67687 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 May 05 14:15:58.177885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1119/1926] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:58.581118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:58.581734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:58.588072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:58.588528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:58.589296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:58.589735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:58.718819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:58.726533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c9321942-1959-4b95-9d2a-815ce293a897 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149185 May 05 14:15:58.727094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 808/1927] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:15:59.189447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:59.190434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:59.196773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:59.197223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:59.197983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:59.198446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:59.226499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-55735aab-7522-4d65-933f-beaed79ad5de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 May 05 14:15:59.227036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1120/1928] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:15:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:15:59.744049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:15:59.744599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:15:59.751059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:59.751515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:59.752289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:15:59.752732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:15:59.876198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:15:59.884050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d183ec93-17bb-411b-96db-59a1a36cde7c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143968 May 05 14:15:59.884614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 809/1929] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:15:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:00.238644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:00.239578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:00.245910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:00.246400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:00.247165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:00.247608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:00.275366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc748d5e-8793-4f1d-b0b0-f83ad5907ac0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040663 May 05 14:16:00.275902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1121/1930] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:00.901235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:00.901883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:00.908487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:00.908962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:00.909768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:00.910246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:01.037326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:01.045048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0369aae-23bd-4487-9ccc-2a291751fbc9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147668 May 05 14:16:01.045617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 810/1931] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:01.287172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:01.288043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:01.295007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:01.295464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:01.296226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:01.296667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:01.324928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5d6c732e-6713-43de-94be-fd94833d56fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041823 May 05 14:16:01.325471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1122/1932] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:02.062461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:02.063077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:02.069435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:02.069891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:02.070687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:02.071127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:02.196030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:02.203755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3deb25af-c074-4d9c-b72e-eec68a9538fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145821 May 05 14:16:02.204321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 811/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:02.336406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:02.337415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:02.344316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:02.344772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:02.345539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:02.345975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:02.374828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0cca23e0-4d05-4243-93dc-fb999bed4c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042376 May 05 14:16:02.375567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1123/1934] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:03.220488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:03.221095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:03.227475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:03.228168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:03.228936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:03.229371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:03.356069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:03.364765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-37c1e44a-be35-4559-85b3-f2f2d38c7e8f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148080 May 05 14:16:03.365339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 812/1935] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:03.386532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:03.387473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:03.394526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:03.394981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:03.395782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:03.396221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:03.425021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-20388993-626c-4074-9f16-f54d3d591c5c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042588 May 05 14:16:03.425568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1124/1936] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:04.380948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:04.381494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:04.387885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:04.388348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:04.389086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:04.389549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:04.437130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:04.438125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:04.444456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:04.444914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:04.445679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:04.446152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:04.474956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38c24118-5572-4460-9ca1-c00e8319bc55 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 May 05 14:16:04.475520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1125/1937] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:04.514412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:04.522342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b9ea2bdc-0017-4dfe-ab6a-b29036786c47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145236 May 05 14:16:04.522917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 813/1938] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:05.487142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:05.488082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:05.494520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:05.494979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:05.495753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:05.496198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:05.527311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-68235973-1a6f-4c99-9837-c2a3a74015f3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044090 May 05 14:16:05.527875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1126/1939] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:05.539800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:05.540407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:05.546839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:05.547289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:05.548046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:05.548482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:05.675392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:05.683222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a87164af-e5d0-4399-b6e3-e26ad61ab847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147499 May 05 14:16:05.683782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 814/1940] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:06.538739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:06.539594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:06.545875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:06.546356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:06.547109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:06.547543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:06.574855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-300ce1e6-d541-4ff5-b04c-d3ceb48ff878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040208 May 05 14:16:06.575890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1127/1941] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:06.702282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:06.702897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:06.709201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:06.709652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:06.710450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:06.710889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:06.850827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:06.858926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5bb66497-b90d-4fe6-9967-14810a707fe2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.160967 May 05 14:16:06.859492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 815/1942] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:07.586330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:07.587267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:07.594142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:07.594606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:07.595447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:07.595898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:07.625020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a3876c7e-4013-4014-a8a3-eedd55818acc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042791 May 05 14:16:07.625571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1128/1943] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:07.875927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:07.876548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:07.882920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:07.883612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:07.884151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:07.884678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:08.017953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:08.026092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-296721a8-32d2-4db6-82ea-9136065eeaee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154019 May 05 14:16:08.026656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 816/1944] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:08.636807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:08.638268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:08.644651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:08.645139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:08.645905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:08.646372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:08.678496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f9b0acc9-3602-4624-9a27-25a924d940e0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 May 05 14:16:08.679060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1129/1945] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:09.043097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:09.043718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:09.050833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:09.051290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:09.052062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:09.052510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:09.179534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:09.187375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0c277fc-8ecb-433d-8347-cd56120c2ed7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148123 May 05 14:16:09.187949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 817/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:09.691911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:09.692877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:09.699214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:09.699665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:09.700430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:09.700870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:09.729470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-934ee425-122d-48ef-b8e6-e9e167a9c4b0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041666 May 05 14:16:09.730025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1130/1947] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:10.385290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:10.385940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:10.392394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:10.392845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:10.393642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:10.394116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:10.567996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:10.576285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-71b82f18-efec-4fec-b39e-0cd43e4b9f40 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.376227 May 05 14:16:10.576842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 818/1948] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:10.866413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:10.867498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:10.873522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:10.873971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:10.874755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:10.875188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:10.903985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44a7cd91-6258-47e9-9147-059491d11bb7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165721 May 05 14:16:10.904527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1131/1949] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:11.592610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:11.593230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:11.599644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:11.600103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:11.600876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:11.601318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:11.727729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:11.736229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-01571c04-fdf0-41a9-9d4d-1f1991146df5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147472 May 05 14:16:11.736795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 819/1950] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:11.914716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:11.915690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:11.922101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:11.922558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:11.923318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:11.923759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:11.951932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e68788d5-bf77-4942-a649-e7c431458d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 May 05 14:16:11.952473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1132/1951] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:12.753398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:12.754054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:12.760361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:12.760807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:12.761561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:12.761994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:12.894859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:12.901686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3949e09e-7810-41d1-b261-ee897f827afd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152099 May 05 14:16:12.902292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 820/1952] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:12.963145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:12.964083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:12.970935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:12.971388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:12.972152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:12.972595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:13.001276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fcd2764b-8755-4c3d-a3af-ba14abdcdc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042135 May 05 14:16:13.001819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1133/1953] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:13.919214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:13.919832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:13.926252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:13.926712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:13.927483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:13.927931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:14.013272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:14.014236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:14.020467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:14.020912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:14.021672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:14.022130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:14.050787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bab4c55a-4885-433f-8fc0-e530a835ccd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041992 May 05 14:16:14.051342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1134/1954] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:14.053106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:14.061359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6a53ee46-e290-4b36-bf13-09483874c8bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146081 May 05 14:16:14.061911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 821/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:15.062786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:15.063711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:15.069972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:15.070445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:15.071198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:15.071630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:15.078551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:15.079168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:15.085322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:15.085785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:15.086601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:15.087046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:15.103309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd3d3f44-c72c-4428-96d9-a113341ccc85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 May 05 14:16:15.106624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1135/1956] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:15.216229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:15.225301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-619fd081-d12e-40c2-9541-b82f39b29ab2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151177 May 05 14:16:15.226046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 822/1957] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:16:16.113590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:16.114555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:16.120857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:16.121303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:16.122724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:16.123157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:16.152322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-da48afdd-c1ee-48ca-89af-0d808c147a3e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042666 May 05 14:16:16.152884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1136/1958] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:16.245745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:16.246371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:16.253243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:16.253690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:16.254493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:16.254929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:16.379003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:16.386787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fb3fece8-edda-4503-a5b9-9f0439df2127 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146650 May 05 14:16:16.387416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 823/1959] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:17.163205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:17.164185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:17.171242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:17.171697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:17.172462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:17.172902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:17.201286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-79943e9d-75a3-456e-9c78-01f65205866b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 May 05 14:16:17.201827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1137/1960] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:17.403215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:17.403833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:17.410227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:17.410687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:17.411451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:17.411892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:17.542916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:17.550694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76873cb9-b804-465b-b036-bdd8618e7675 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151341 May 05 14:16:17.551250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 824/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:18.212760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:18.213689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:18.220525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:18.220978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:18.221735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:18.222204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:18.250871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc38cdaf-fdb4-4812-8579-d4664554b8c8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042067 May 05 14:16:18.251411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1138/1962] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:18.567496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:18.568152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:18.574359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:18.574843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:18.575612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:18.576110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:18.701028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:18.713119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a6401ca2-5463-470a-a148-4c0f4c589c08 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149451 May 05 14:16:18.713690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 825/1963] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:19.262494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:19.263450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:19.269725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:19.270212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:19.270968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:19.271401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:19.299481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24fa9060-260d-4661-94f2-2ca56fbb683e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040908 May 05 14:16:19.299958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1139/1964] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:19.730988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:19.732217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:19.738143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:19.738595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:19.739355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:19.739789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:19.862338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:19.870024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4ad62c8b-2084-44d1-9132-a8aa0348a0ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143297 May 05 14:16:19.870598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 826/1965] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:20.311725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:20.312664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:20.318983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:20.319440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:20.320202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:20.320642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:20.349439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a615819-c4a0-4819-9a31-467034fed915 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 May 05 14:16:20.350004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1140/1966] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:20.885957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:20.886629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:20.893547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:20.893991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:20.894776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:20.895211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:21.025591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:21.035446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-14785853-81ee-488d-92ec-f06d97655e23 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153279 May 05 14:16:21.036014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 827/1967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:21.361186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:21.362152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:21.368542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:21.368995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:21.369765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:21.370232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:21.398910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc882441-afb2-4b11-a8b0-d9fe00695058 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 May 05 14:16:21.399483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1141/1968] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:22.052238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:22.052847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:22.059699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:22.060147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:22.060903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:22.061333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:22.185632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:22.193436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-af64b623-6663-4d11-960b-6a0d257f28c1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145051 May 05 14:16:22.193998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 828/1969] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:22.410229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:22.411195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:22.417629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:22.418115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:22.419391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:22.419833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:22.448191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6d11129f-14a2-40a3-bd12-e0993207aaaf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041964 May 05 14:16:22.448735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1142/1970] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:23.210384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:23.210994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:23.218070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:23.218519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:23.219274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:23.219706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:23.350161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:23.358324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76090d89-00fb-42f5-86cf-20f3bb00d04f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151736 May 05 14:16:23.358878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 829/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:23.459743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:23.460676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:23.467548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:23.468003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:23.468770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:23.469210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:23.498363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a49d276-bb2a-46d9-9c61-bc1ecb529878 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042697 May 05 14:16:23.498907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1143/1972] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:24.375269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:24.375889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:24.382288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:24.382745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:24.383544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:24.383981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:24.508492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:24.509222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:24.510749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:24.516933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-51ffe865-648e-4220-b05a-eb5142dbc403 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145561 May 05 14:16:24.517265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:24.517505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 830/1973] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:24.517721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:24.518590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:24.519096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:24.547811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0d0ffe78-05de-4ecd-93ff-5abb8e5ba877 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 May 05 14:16:24.548355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1144/1974] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:25.534393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:25.535015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:25.541283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:25.541737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:25.549750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:25.549750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:25.559274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:25.560301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:25.566618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:25.567074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:25.567845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:25.568282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:25.598705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ffdc2f30-ca45-4160-aeaf-2ee53fdb4b38 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 May 05 14:16:25.599258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1145/1975] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:25.688378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:25.696114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5cbca0b8-733d-4675-90a7-f923e2c731d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.165592 May 05 14:16:25.696875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 831/1976] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:26.611174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:26.612319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:26.618840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:26.619294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:26.620060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:26.620502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:26.649932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2f2e6736-2b31-4e2d-9463-20e3c1036bbb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 May 05 14:16:26.650929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1146/1977] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:26.713107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:26.713719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:26.722097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:26.722575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:26.723345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:26.723778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:26.859924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:26.868007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f0abe89a-328f-4b78-9fd5-8e8ad019f32f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.158806 May 05 14:16:26.868507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 832/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:27.662298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:27.663229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:27.670066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:27.670526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:27.671287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:27.671727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:27.701260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b1c099ff-a40e-4dd3-be7c-87f5ba9958cc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 May 05 14:16:27.701805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1147/1979] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:27.887244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:27.887855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:27.894146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:27.894599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:27.895357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:27.895792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:28.028386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:28.036023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-563750c6-e1b5-440d-a439-5729ddd6e723 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152583 May 05 14:16:28.036578 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 833/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:28.712902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:28.713841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:28.720422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:28.720879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:28.721643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:28.722126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:28.751014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31294b26-d0cf-4db3-8ebd-df19e47aa12b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042169 May 05 14:16:28.751570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1148/1981] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:29.052724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:29.053336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:29.060221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:29.060675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:29.061436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:29.061902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:29.189196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:29.196958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f608cf82-b521-454f-9a50-33c0b2495d8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148339 May 05 14:16:29.197518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 834/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:29.763135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:29.764083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:29.770590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:29.771047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:29.771822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:29.772268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:29.800828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05ffe5ed-3ce3-41f0-b9ac-99e845f8952b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042184 May 05 14:16:29.801375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1149/1983] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:30.213926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:30.214582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:30.221417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:30.221871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:30.222680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:30.223118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:30.348364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:30.356429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1a48dd2f-6798-4f76-8c16-bc4c79254e7d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146332 May 05 14:16:30.356996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 835/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:30.812626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:30.813471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:30.819992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:30.820438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:30.821195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:30.821625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:30.849488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9753a203-c926-43ad-8b2d-b1acfbdfb085 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040918 May 05 14:16:30.850030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1150/1985] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:31.373208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:31.373808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:31.380094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:31.380541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:31.381302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:31.381737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:31.507385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:31.515647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5cc87faa-8877-49a7-bc0f-5b507040da02 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146363 May 05 14:16:31.516212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 836/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:31.860904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:31.861851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:31.868238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:31.868694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:31.869489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:31.869935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:31.898302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6ebb4cf6-27bb-4b5d-a8a3-2c8a02655174 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041393 May 05 14:16:31.898841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1151/1987] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:32.532560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:32.533108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:32.539534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:32.539986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:32.540753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:32.541194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:32.663200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:32.671391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c906cde9-5676-4fac-917e-8117064726c2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142792 May 05 14:16:32.671956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 837/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:32.909826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:32.910983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:32.917354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:32.917809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:32.919165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:32.925992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:32.949149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-621bf3d2-072a-4c39-bb63-18800d642907 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 May 05 14:16:32.949703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1152/1989] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:33.689305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:33.689923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:33.696306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:33.696758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:33.697525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:33.697966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:33.831458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:33.839651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f99a01da-ba31-4391-b295-800437f630de tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154136 May 05 14:16:33.840735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 838/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:33.960720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:33.961571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:33.968467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:33.968916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:33.969666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:33.970138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:34.002371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ca70d5ba-1c06-44ab-9968-5f1e323f4e0a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 May 05 14:16:34.003789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1153/1991] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:34.857391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:34.858059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:34.864375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:34.864851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:34.865623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:34.866097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:34.997244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:35.004936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92e0c434-2212-47eb-a97a-7a65b5195fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151650 May 05 14:16:35.005497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 839/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:35.014513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:35.015478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:35.021916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:35.022411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:35.023179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:35.023620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:35.052435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f52a6b4-c134-415a-a9b6-7e724232d8e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 May 05 14:16:35.052992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1154/1993] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:36.022728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:36.023455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:36.030320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:36.030825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:36.031597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:36.032039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:36.063956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:36.065518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:36.071957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:36.072416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:36.073186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:36.073632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:36.103631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-edd52667-1d1f-4280-929c-910452be4eff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 May 05 14:16:36.104113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1155/1994] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:36.170049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:36.177949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a7023cd7-f9e1-406f-90a2-b2ebdb54844e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.159118 May 05 14:16:36.178564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 840/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:37.115921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:37.116855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:37.123830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:37.124285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:37.125049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:37.125484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:37.153276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d77665a3-2a7b-4222-aceb-ae78d043e6cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041385 May 05 14:16:37.153816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1156/1996] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:37.194902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:37.195557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:37.201865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:37.202351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:37.203125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:37.203567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:37.332686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:37.340532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eabeeac5-7e46-4a5c-bf36-48fd7d79a75e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149506 May 05 14:16:37.341309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 841/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:38.165072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:38.166002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:38.172858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:38.173312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:38.174098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:38.174542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:38.202945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f7290288-45e2-4c5b-9e26-57f3fdda1c50 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 May 05 14:16:38.203490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1157/1998] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:38.357643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:38.358218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:38.364661 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:38.365110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:38.365912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:38.366382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:38.490754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:38.499099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cb0eecb8-e9c1-4d1e-b75a-91901defbbfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145638 May 05 14:16:38.499754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 842/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:39.214671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:39.216065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:39.222322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:39.222772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:39.223520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:39.223955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:39.252379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2fd3e3f8-17e7-4334-b0d8-18321e2be69d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041747 May 05 14:16:39.252911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1158/2000] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:39.516358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:39.516905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:39.523265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:39.523724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:39.524496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:39.524940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:39.653098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:39.661794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-34f4a675-f5a2-43bc-a0a0-179b30d91e97 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149795 May 05 14:16:39.662399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 843/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:40.263927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:40.264861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:40.271205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:40.271679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:40.272429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:40.272876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:40.301743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3069dda6-05c9-44a3-98a7-a0b4432617a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 May 05 14:16:40.302334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1159/2002] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:40.679192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:40.679732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:40.686683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:40.687141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:40.687916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:40.688360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:40.811647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:40.819412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e76287ab-1d95-4d68-898b-1568d93d6f06 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144117 May 05 14:16:40.819980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 844/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:41.312956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:41.313963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:41.320404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:41.320923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:41.321916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:41.322446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:41.351462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4674ef7c-a44c-41ae-80cf-3d1784a42ff7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042502 May 05 14:16:41.352113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1160/2004] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:41.836618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:41.837262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:41.844198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:41.844654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:41.845429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:41.845870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:41.968271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:41.975932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ca08100-0685-49e1-8f10-560bb17a0b88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143145 May 05 14:16:41.976497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 845/2005] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:42.364241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:42.365201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:42.371642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:42.372095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:42.372858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:42.373298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:42.401613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2851b31-f814-4897-b913-a2dc95155661 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 May 05 14:16:42.402185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1161/2006] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:42.992734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:42.993248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:43.000213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:43.000667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:43.001432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:43.001867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:43.131278 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:43.139169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1c58cc36-d7d5-414b-8135-f29f68bc3a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150412 May 05 14:16:43.139737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 846/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:43.413087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:43.414032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:43.420946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:43.421395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:43.422184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:43.422620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:43.450993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-78aaf9fa-9b72-4ebb-a86e-36a6a905955b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041840 May 05 14:16:43.451523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1162/2008] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:44.156591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:44.157209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:44.163536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:44.163989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:44.164754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:44.165196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:44.287633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:44.295342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1cb74e6-923d-494a-a017-3d39519b0321 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143185 May 05 14:16:44.295908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 847/2009] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:44.462380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:44.463271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:44.469557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:44.470002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:44.470787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:44.471221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:44.499699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0c723e4d-a39b-4a8a-b964-d8d2a8910402 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041322 May 05 14:16:44.500233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1163/2010] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:45.312305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:45.312836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:45.319848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:45.320293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:45.321052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:45.321491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:45.448464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:45.456699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7bb6c39b-7076-47d7-b668-8132f071437f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148500 May 05 14:16:45.457256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 848/2011] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:45.510995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:45.511918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:45.518260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:45.518709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:45.519464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:45.519900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:45.547945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e76f5d46-01a2-4230-a2db-2723e015eb09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 May 05 14:16:45.548520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1164/2012] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:46.472537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:46.473083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:46.479755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:46.480249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:46.481062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:46.481511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:46.559906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:46.560846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:46.567257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:46.567713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:46.568493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:46.568935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:46.598123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cbe71b5e-eac5-4708-8713-8bb4bba4c6f4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042653 May 05 14:16:46.598714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1165/2013] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:46.605883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:46.613706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-82e07e05-5822-404a-a5d4-092d682959ac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145015 May 05 14:16:46.614298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 849/2014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:47.610366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:47.611304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:47.617656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:47.618131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:47.618903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:47.619349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:47.630912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:47.631526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:47.638323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:47.638779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:47.639612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:47.640058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:47.648905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-932b4e6d-1771-4af0-88d8-28ab3ecf989b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 May 05 14:16:47.649479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1166/2015] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:47.767417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:47.775206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9812c26d-d592-47ef-9824-0a8a4e0b80ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148127 May 05 14:16:47.775769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 850/2016] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:16:48.660731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:48.661663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:48.668835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:48.669286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:48.670085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:48.670526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:48.699588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7d06e1e8-2c52-47f4-be00-ccb6a2ad0cf9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043038 May 05 14:16:48.700139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1167/2017] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:48.792684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:48.793891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:48.800259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:48.803274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:48.803274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:48.803274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:48.926520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:48.934353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-46ceea48-163d-4150-8db3-8fa7dcc018a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145511 May 05 14:16:48.934917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 851/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:49.711531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:49.712483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:49.719309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:49.719756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:49.720527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:49.720946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:49.749379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3db82e2f-41d0-41e4-b818-906ec31fe334 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041810 May 05 14:16:49.749913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1168/2019] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:49.951147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:49.951764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:49.957852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:49.958399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:49.959177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:49.959615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:50.085787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:50.094685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7d0d2ca0-0bcc-4c45-9f45-ec4dd29860fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147336 May 05 14:16:50.095618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 852/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:50.760859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:50.762311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:50.768619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:50.769077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:50.769837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:50.770299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:50.799082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cb341480-ab73-4e99-b407-78332dfb0f8b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042168 May 05 14:16:50.799624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1169/2021] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:51.112106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:51.112718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:51.118746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:51.119190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:51.119953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:51.120383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:51.251247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:51.259136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-626b8eb3-d3b7-4be2-89d2-fa37c5e7fbb8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151000 May 05 14:16:51.259725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 853/2022] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:51.810455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:51.811382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:51.817736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:51.818230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:51.818996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:51.819437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:51.847581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-74a86fd7-c498-43b0-ad8e-e0b8b02c4899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 May 05 14:16:51.848130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1170/2023] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:52.276616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:52.277239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:52.283550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:52.284009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:52.284779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:52.285223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:52.407575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:52.415295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a0fb319d-6c37-4de5-b57f-fae2f1690f3c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142465 May 05 14:16:52.415866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 854/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:52.858953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:52.859877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:52.866200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:52.866651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:52.867413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:52.867848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:52.897161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d526366b-f84c-4153-a5b2-eb79076d4d5a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042198 May 05 14:16:52.897729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1171/2025] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:53.432662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:53.433181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:53.440156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:53.440610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:53.441380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:53.441825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:53.566743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:53.575510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b271eb9a-598f-429d-aab2-26581c9c18fd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146720 May 05 14:16:53.576109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 855/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:53.908682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:53.909605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:53.915902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:53.916354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:53.917104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:53.917538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:53.946343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ad69c5db-8930-42ba-b3cd-b52e189a0e78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041669 May 05 14:16:53.946884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1172/2027] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:54.592978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:54.593598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:54.599960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:54.600407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:54.601172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:54.601604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:54.729022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:54.736868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3ab6f1e1-f553-4ca9-98d5-588efa8eca1b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148330 May 05 14:16:54.737433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 856/2028] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:54.956926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:54.957786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:54.964147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:54.964742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:54.965415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:54.965860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:54.999114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44ef8035-f2d0-40c2-bc87-13e3cc27ebe4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 May 05 14:16:55.001112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1173/2029] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:55.754142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:55.754759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:55.761115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:55.761571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:55.762372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:55.762815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:55.885082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:55.893416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b18074c1-1420-41f4-9557-f83360199fdc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143165 May 05 14:16:55.893982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 857/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:56.018236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:56.019084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:56.025699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:56.026186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:56.027576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:56.028033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:56.056009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-446c4635-61bc-4161-830d-0333f60c0e7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041883 May 05 14:16:56.056545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1174/2031] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:56.911091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:56.911628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:56.918584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:56.919040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:56.919813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:56.920260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:57.054958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:57.062992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8282162f-852f-4313-8fc1-a566edc17c3a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.155883 May 05 14:16:57.063557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 858/2032] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:57.066946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:57.067900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:57.074394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:57.074856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:57.075628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:57.076075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:57.106649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c317384-b29c-432d-861a-6f835ec7d9a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 May 05 14:16:57.107210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1175/2033] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:58.080556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:58.081164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:58.087478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:58.087925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:58.088684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:58.089118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:58.118303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:58.119264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:58.125664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:58.126164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:58.126944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:58.127559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:58.156107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38fe8f44-a16e-45c0-aaf5-84f2e81e0924 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 May 05 14:16:58.156669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1176/2034] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:16:58.216438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:58.224166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7e9bf232-68d3-4af1-af28-75c91a7296a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147497 May 05 14:16:58.224729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 859/2035] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:16:59.167358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:59.168799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:59.175187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:59.175651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:59.176418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:59.176856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:59.205363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9da48f90-c0be-49f3-8c1e-83447d7f049c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 May 05 14:16:59.205926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1177/2036] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:16:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:16:59.241584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:16:59.242261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:16:59.248590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:59.249039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:59.249797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:16:59.250266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:16:59.373974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:16:59.381632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a28b242d-831c-482d-9314-f34052f2f1a7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143854 May 05 14:16:59.382210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 860/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:16:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:00.216658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:00.217600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:00.223940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:00.224401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:00.225168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:00.225617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:00.256059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5d34ce54-eaa0-4962-b5e3-7ae1c7b5563c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 May 05 14:17:00.256617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1178/2038] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:00.397858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:00.398429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:00.404758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:00.405206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:00.405959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:00.406425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:00.534354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:00.542136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-faed3578-52a1-472f-95c2-59ce3f1f1c78 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148099 May 05 14:17:00.543214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 861/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:01.267766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:01.268704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:01.275179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:01.275636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:01.276407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:01.276903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:01.305673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a1085c57-be9f-443b-9629-22fd82efaf6d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041892 May 05 14:17:01.306153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1179/2040] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:01.559264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:01.559814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:01.566141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:01.566590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:01.567349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:01.567787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:01.696342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:01.729235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6042f9b9-e3bd-42f7-af7f-dde6b457e5f1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149840 May 05 14:17:01.729235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 862/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:02.317756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:02.318723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:02.325010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:02.325466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:02.326259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:02.326703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:02.355959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f7e68304-c903-42e7-b6b2-9dc57c60c1d5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 May 05 14:17:02.356429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1180/2042] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:02.721596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:02.722248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:02.728745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:02.729264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:02.730154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:02.730604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:02.853144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:02.861146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-993e7931-6044-4435-bad8-e3ef9ddd4bad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143528 May 05 14:17:02.861706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 863/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:03.367118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:03.368048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:03.375056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:03.375512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:03.376274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:03.376723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:03.404573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3cbad917-ae54-448d-82b7-44532b09e113 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 May 05 14:17:03.405115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1181/2044] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:03.877700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:03.878298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:03.884666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:03.885121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:03.885890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:03.886373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:04.016298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:04.024382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76f7e570-581c-43f1-bc44-fb11f2c63401 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150516 May 05 14:17:04.024948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 864/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:04.416135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:04.417052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:04.423396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:04.423849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:04.424602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:04.425036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:04.453004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0848ed79-ed98-491c-b617-741610a5906a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040850 May 05 14:17:04.453529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1182/2046] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:05.042563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:05.043170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:05.049401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:05.049843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:05.050633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:05.051069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:05.179289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:05.187524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1d5fa248-4a3d-41c1-a5ce-be672131c5fb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149417 May 05 14:17:05.188081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 865/2047] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:05.464416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:05.465851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:05.472223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:05.472677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:05.473443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:05.473886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:05.505129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fcb710e9-9718-4a02-b90a-eff1e4668ec0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 May 05 14:17:05.505693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1183/2048] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:06.204895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:06.205509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:06.211946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:06.212395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:06.213158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:06.213597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:06.338978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:06.347795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31f11b7b-0262-4ba0-a92e-d791d8dd5282 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146721 May 05 14:17:06.348370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 866/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:06.517039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:06.517922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:06.524403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:06.524854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:06.525622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:06.526091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:06.554198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a61fc50c-b94b-45b4-91c9-e288a788755f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041118 May 05 14:17:06.554733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1184/2050] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:07.364598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:07.365233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:07.372396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:07.372854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:07.373815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:07.374077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:07.501590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:07.509464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7f23b3af-39bd-4c16-9e4b-45081eb4dbaf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148767 May 05 14:17:07.510036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 867/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:07.565447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:07.566424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:07.572669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:07.573119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:07.573872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:07.574338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:07.603239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-705bc975-d366-4cb2-8860-31d1a7bf35fe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041674 May 05 14:17:07.605081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1185/2052] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:08.526038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:08.526666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:08.533088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:08.533543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:08.534343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:08.534784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:08.615671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:08.616612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:08.623663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:08.624121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:08.624897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:08.625343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:08.654964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c137dbe-8e86-459f-b488-c220f115d07e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 May 05 14:17:08.655529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1186/2053] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:17:08.668832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:08.676698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92ff268f-70eb-4db3-a7a6-4f9508e5883b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154534 May 05 14:17:08.677252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 868/2054] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:09.668619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:09.669653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:09.676089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:09.676546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:09.677317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:09.677764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:09.694227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:09.694851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:09.701780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:09.702262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:09.703037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:09.703478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:09.708059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-32a5e798-79c5-4367-a567-7daef160bbd2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 May 05 14:17:09.708628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1187/2055] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:09.825931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:09.833689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-04c54716-83ba-4b71-a5c7-567e94e9da49 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143327 May 05 14:17:09.834292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 869/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:10.719498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:10.720384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:10.726786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:10.727269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:10.728036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:10.728477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:10.757420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a8d66999-74f1-4c6d-85d6-bcf80acd14db tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 May 05 14:17:10.757955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1188/2057] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:10.851309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:10.851926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:10.859071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:10.859525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:10.860288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:10.860727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:10.987916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:10.996007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2003f962-d523-4fca-be29-f2853c407717 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148500 May 05 14:17:10.997172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 870/2058] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:11.768852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:11.769784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:11.776162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:11.776618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:11.778074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:11.778522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:11.806354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b9504bef-e562-4a20-9dea-cd91fdebc795 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041422 May 05 14:17:11.806899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1189/2059] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:12.012115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:12.012729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:12.019053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:12.019505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:12.020271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:12.020706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:12.146630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:12.154374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c33ab7b9-ba2e-44ff-9a30-e3c8b73c23f8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146035 May 05 14:17:12.155230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 871/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:12.817919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:12.818872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:12.825188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:12.825635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:12.826438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:12.826870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:12.855370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f2533f8-2f6b-48a8-9e24-5367df19bd88 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041427 May 05 14:17:12.856606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1190/2061] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:13.171196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:13.171832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:13.178355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:13.178809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:13.179576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:13.180208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:13.568337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:13.578176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9ee75d85-2ce6-41a7-82a1-542b009469bc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.410884 May 05 14:17:13.579225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 872/2062] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:13.867641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:13.868574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:13.875567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:13.876020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:13.876785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:13.877223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:13.904954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-14677433-9aa9-48bc-9c81-bfadf4201487 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 May 05 14:17:13.905487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1191/2063] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:14.595759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:14.596372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:14.602689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:14.603162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:14.604182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:14.604615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:14.737679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:14.745463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-24a889bd-42c9-453e-8310-339b78fb2f2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153558 May 05 14:17:14.746044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 873/2064] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:14.916298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:14.917150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:14.923902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:14.924345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:14.925103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:14.925536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:14.953646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f73062eb-6f28-41ce-aa96-df8600397567 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 May 05 14:17:14.954234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1192/2065] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:15.763611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:15.764260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:15.770765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:15.771223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:15.771995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:15.772444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:15.896866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:15.904729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0020cc10-6742-4a43-a59f-ee819ae7d794 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145592 May 05 14:17:15.905292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 874/2066] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:15.965075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:15.966081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:15.972393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:15.972854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:15.973713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:15.974260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.004809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-892b662d-da7a-40fc-b0c8-9eebb37ccd7e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043819 May 05 14:17:16.005348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1193/2067] 10.222.0.26 () {58 vars in 1301 bytes} [Thu May 5 14:17:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:17:16.345231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:16.345734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:16.351503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.351953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.352782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.353170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.379176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:17:16.663190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9f4cff28-28de-4bed-b49b-11bd13657d0f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 204 len: 0 microversion: 2.1 time: 0.321336 May 05 14:17:16.663728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 875/2068] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:17:16 2022] DELETE /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:17:16.672412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:16.677470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:16.679054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.679505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.680256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.680691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.853972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:16.861666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6a6e581-07ba-4e31-a2a4-6c755f1b66e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1601 microversion: 2.1 time: 0.193685 May 05 14:17:16.862251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1194/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1601 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:16.921872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:16.922566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:16.929486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.929965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:16.930749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:16.931211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.016779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:17:17.021759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:17.024333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.024781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.025551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.025992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.067334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:17.076438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bdc59e9d-8b61-40b1-a16b-012ea95f0985 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.158767 May 05 14:17:17.077007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 876/2070] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:17.274091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba018b88-5d3a-41f0-82fc-964f81831d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "POST /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/action" status: 200 len: 41753 microversion: 2.1 time: 0.261401 May 05 14:17:17.274668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1195/2071] 10.222.0.26 () {60 vars in 1277 bytes} [Thu May 5 14:17:17 2022] POST /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66/action => generated 41753 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 05 14:17:17.440119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:17.440736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:17.447210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.447765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.448632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.449197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.475448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:17:17.778073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a4ce3bb-caa1-4d7b-8b52-fb0fbc6678bb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 204 len: 0 microversion: 2.1 time: 0.341393 May 05 14:17:17.778678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 877/2072] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:17:17 2022] DELETE /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:17:17.795189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:17.795906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:17.807964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.808448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.809228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.809669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.909965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-e89649bf-c9a7-4b07-a0fb-b8b685fc778d req-e3cf173d-252c-4e6a-a955-446a86976436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a3b3a4-b7f6-4697-a2b4-11913492a055", "name": "network-vif-deleted", "tag": "b70d099e-c754-4a00-8570-a5978889ba6b"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:17:17.923007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-e89649bf-c9a7-4b07-a0fb-b8b685fc778d req-e3cf173d-252c-4e6a-a955-446a86976436 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.924120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-e89649bf-c9a7-4b07-a0fb-b8b685fc778d req-e3cf173d-252c-4e6a-a955-446a86976436 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.936256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-e89649bf-c9a7-4b07-a0fb-b8b685fc778d req-e3cf173d-252c-4e6a-a955-446a86976436 service nova] Creating event network-vif-deleted:b70d099e-c754-4a00-8570-a5978889ba6b for instance 11a3b3a4-b7f6-4697-a2b4-11913492a055 on hv-cinder-73761 May 05 14:17:17.941822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-e89649bf-c9a7-4b07-a0fb-b8b685fc778d req-e3cf173d-252c-4e6a-a955-446a86976436 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093159 May 05 14:17:17.942612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 878/2073] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:17:17.946044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:17.948648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:17.949348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:17.954417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26ac9ecc-8188-4202-8ecb-f9da2a930963 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.170080 May 05 14:17:17.957338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1196/2074] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:17.957548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.957548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:17.957548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:17.957993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:18.025468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:18.034362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c7c7d0f7-ed49-4d63-a8dc-57a604e88b0e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1559 microversion: 2.1 time: 0.090575 May 05 14:17:18.034915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 879/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1559 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:18.093250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:18.094943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:18.100541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:18.101008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:18.101832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:18.102306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:18.235162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:18.243423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2af6abe5-f890-45a3-b528-09e5d498fcd3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154634 May 05 14:17:18.244264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1197/2076] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:18.972467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:18.973018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:18.979654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:18.980107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:18.980869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:18.981309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:19.058133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:19.058794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:19.065573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:19.066042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:19.072159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:19.073218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:19.127365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:19.135239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a6cab4f2-69f2-4c25-a0f6-9921e5ff8a9d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.166724 May 05 14:17:19.135802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 880/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:18 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:19.145998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:19.153700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-898f1488-a523-4b15-b451-fc2dbc0a3d64 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.105822 May 05 14:17:19.154295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1198/2078] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:19.260463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:19.261008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:19.267027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:19.267470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:19.268224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:19.268656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:19.392112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:19.400019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e883da8-36a3-46d5-96c1-ecd1f85d00e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143432 May 05 14:17:19.400597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 881/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:20.152449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:20.153103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:20.160199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.160654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.161420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.161857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.170327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:20.170959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:20.176904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.177367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.178171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.178620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.256334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:20.265007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-598634c8-e028-491a-a0d4-2dd1f60b4c63 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.098664 May 05 14:17:20.265791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 882/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:20.316288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:20.324062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c59c716f-efef-4ec6-95b9-fcdac3706372 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.175457 May 05 14:17:20.324636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1199/2081] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:20.416565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:20.417114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:20.426819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.427274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.428032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:20.428468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:20.558727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:20.567126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a2f267e6-6d08-4e6c-b8bc-d32036806670 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154500 May 05 14:17:20.567698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 883/2082] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:21.282430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:21.283047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:21.289427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.289878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.290670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.291110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.342370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:21.343014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:21.349361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.349821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.350618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.351083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.352507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:21.360608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d0823fd0-1d26-48aa-a8b1-7fbbdd6b205d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082695 May 05 14:17:21.361373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1200/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:21.477486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:21.485511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-82a29732-a97e-47dd-b3be-72316ec972c4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147594 May 05 14:17:21.486094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 884/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:21 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:21.583811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:21.584431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:21.590388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.590846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.592335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:21.592838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:21.715114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:21.722855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e719c6b-e636-4ea1-9cdc-49adc0a18546 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142915 May 05 14:17:21.723420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1201/2085] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:22.377306 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:22.377837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:22.384307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.384757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.385526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.385962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.445055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:22.452749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-024efe0a-f59b-48eb-9ddc-ef6e8df76aac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080011 May 05 14:17:22.453320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 885/2086] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:22.502424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:22.503033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:22.509325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.509771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.510551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.510984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.637718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:22.645476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-30eec8a4-f584-4165-aeb6-8c2de1540995 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146846 May 05 14:17:22.646063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1202/2087] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:22 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:22.739889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:22.740510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:22.746411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.746872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.747643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:22.748087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:22.870783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:22.878612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c2f5d48-0e32-49f4-a08a-e49dcea352d4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142561 May 05 14:17:22.879184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 886/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:23.470247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:23.470867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:23.476911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.477343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:23.478129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.478567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:23.542139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:23.549904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e772f85-f156-428c-8b07-40297a6bd9c7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084119 May 05 14:17:23.550509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1203/2089] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:23.662901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:23.663507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:23.669815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.670295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:23.671056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.671488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:23.809513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:23.817331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4d9bb6eb-d4fc-432f-9b50-cc92982eb6be tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158278 May 05 14:17:23.817895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 887/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:23 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:23.895436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:23.896057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:23.902104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.902563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:23.903325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:23.904259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:24.027773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:24.036645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d74566a1-5b28-4e51-b87e-154abdfdc3e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144941 May 05 14:17:24.037272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1204/2091] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:24.566358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:24.566997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:24.572909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:24.573354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:24.574143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:24.574579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:24.637321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:24.645689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b96d6949-ec46-4bb5-8497-315ceebf13d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083182 May 05 14:17:24.646291 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 888/2092] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:24.834764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:24.835405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:24.842320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:24.842776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:24.843547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:24.843988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:24.968189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:24.975944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aaefabda-b98e-4f6c-ad50-2e3b15a9212f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145028 May 05 14:17:24.976511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1205/2093] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:24 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:25.054152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:25.054770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:25.062974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:25.063866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:25.065704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:25.066593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:25.194812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:25.203124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cc26d63e-ebc8-4d33-89c7-a3c07dc7c905 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152838 May 05 14:17:25.203700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 889/2094] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:25.662346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:25.662964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:25.668992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:25.670116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:25.670882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:25.671323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:25.734945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:25.742825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6bc5381f-f5bc-404c-a671-6946d0ab0443 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084384 May 05 14:17:25.743386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1206/2095] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:25.993390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:25.993921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:25.999913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.000367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.001131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.001570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.139853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:26.147589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0d53d251-0ce2-4d17-a9dc-1a9262bc1d49 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158193 May 05 14:17:26.148147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 890/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:26.220434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:26.221041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:26.227302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.227747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.228495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.229192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.352760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:26.360734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac6d5963-05bb-4816-8002-00e1ae6dca64 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144114 May 05 14:17:26.361295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1207/2097] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:26.759899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:26.760517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:26.767150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.767597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.768358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:26.768791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:26.839481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:26.847841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2bd2aeec-d6a3-4f32-89a7-f11b3c603bb6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091887 May 05 14:17:26.848405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 891/2098] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:27.164750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:27.165358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:27.171458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.171908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.172659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.173119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.297530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:27.305311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa193354-e796-4d04-b0d0-72a51c12abdb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144397 May 05 14:17:27.305874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1208/2099] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:27.377291 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:27.377918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:27.384763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.385496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.386442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.386865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.520396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:27.528158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-27dcea06-a7a7-4188-8bc5-85501ecb9f7e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.155398 May 05 14:17:27.528723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 892/2100] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:27.865188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:27.865808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:27.871943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.872395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.873191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:27.873630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:27.937742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:27.945566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-77cf3628-501c-485e-a8cd-f4bec04fed21 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084305 May 05 14:17:27.946159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1209/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:28.323141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:28.323669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:28.330311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.330768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:28.331540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.331978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:28.460284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:28.468774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ebcaf19e-4adc-4b60-95ec-abb17de0f920 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149674 May 05 14:17:28.469354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 893/2102] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:28.545226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:28.545839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:28.552518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.553016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:28.553762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.554233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:28.693504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:28.703933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7dfaf81b-22cd-46a1-9065-731d20fb4852 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.163087 May 05 14:17:28.704517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1210/2103] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:28.961849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:28.962421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:28.969738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.970240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:28.971016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:28.971448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:29.034227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:29.041939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ee70446-6b37-4801-80d5-a2c6935c14c1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084056 May 05 14:17:29.042520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 894/2104] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:29.487756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:29.488367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:29.494427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:29.494874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:29.495624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:29.496057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:29.619423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:29.627154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0db3c72d-d2c2-4096-a92f-f991be173f9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143316 May 05 14:17:29.627721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1211/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:29 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:29.723999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:29.724627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:29.733837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:29.734331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:29.735107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:29.735549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:29.858723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:29.866452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0cc78a83-bb6d-49f7-9f52-12b37b864c58 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148376 May 05 14:17:29.867019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 895/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:30.059229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:30.060402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:30.066400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.066868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:30.067614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.068053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:30.130830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:30.139232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7627f520-5023-4c0e-b095-02bc7884c1b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083886 May 05 14:17:30.139797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1212/2107] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:30.644149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:30.644758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:30.651288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.651738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:30.652539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.652978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:30.779287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:30.787033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2b6e10ad-7d6a-489c-a490-8d30b8123aaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146767 May 05 14:17:30.787596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 896/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:30 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:30.883175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:30.883791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:30.890141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.890598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:30.891358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:30.891797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:31.017440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:31.025165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-06026ef3-394d-46d2-a840-b975b107ec31 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145796 May 05 14:17:31.025724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1213/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:31.156245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:31.156883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:31.162944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:31.171270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:31.171270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:31.171270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:31.227274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:31.235941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2b41e46c-febf-4310-b81b-cc149e6ed6b2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083695 May 05 14:17:31.236540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 897/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:31.804073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:31.804698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:31.811455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:31.811912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:31.812710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:31.813186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:31.937971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:31.945696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84b3102e-58a6-4759-9564-6f9041d7a726 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145555 May 05 14:17:31.946290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1214/2111] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:31 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:32.042460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:32.043080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:32.049867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.050356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:32.051123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.051564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:32.176328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:32.183980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7bcbf964-575d-4313-bac8-cf464c7ec872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145377 May 05 14:17:32.184547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 898/2112] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:32.252405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:32.253029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:32.258912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.259372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:32.260139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.260582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:32.322805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:32.330522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-89f27df2-b851-4a80-8ff0-3312245fc26d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081923 May 05 14:17:32.331112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1215/2113] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:32.962540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:32.963151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:32.969080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.969534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:32.970335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:32.970774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:33.097088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:33.105597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bd14d001-632d-4e9b-bdc1-1773e8d92358 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147133 May 05 14:17:33.106204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 899/2114] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:33.201072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:33.201701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:33.208010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:33.208458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:33.209210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:33.209645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:33.332242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:33.340018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8db8ba16-6128-4d7d-a3ac-92a84b24c18f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143362 May 05 14:17:33.340589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1216/2115] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:33.348073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:33.348685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:33.354697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:33.355139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:33.355895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:33.356328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:33.417801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:33.425967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9f9a32b3-23b4-4ad8-a905-51987f302103 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082631 May 05 14:17:33.426560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 900/2116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:34.122867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:34.123485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:34.129403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.129857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.130688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.131133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.255648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:34.263987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3090dea7-e599-455e-bffb-0b91833ebefc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145079 May 05 14:17:34.264751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1217/2117] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:34.357318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:34.357892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:34.364318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.364768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.365535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.365975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.444295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:34.445123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:34.451775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.452215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.453016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:34.453735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:34.506816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:34.515070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c3c03b43-56bf-4bb2-9448-2672eadb1bfa tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.161807 May 05 14:17:34.515647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 901/2118] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:34.528429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:34.536687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-41d73910-3df5-4ce4-8219-c4cd16e8df45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.097140 May 05 14:17:34.537246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1218/2119] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:35.280996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:35.281602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:35.287748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.288225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.288992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.289429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.416355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:35.427585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3c2ea0b0-e49f-484d-b625-9ec152d7f3b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150824 May 05 14:17:35.428159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 902/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:35.531811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:35.532428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:35.538772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.539221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.539974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.540407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.553835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:35.554580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:35.560379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.560835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.561607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:35.562062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:35.636392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:35.644874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-112c3b49-c08f-4852-82b3-d34029aea42a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.094828 May 05 14:17:35.645449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 903/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:35.694245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:35.702593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-15d3abd7-66ed-48e1-8035-22e859acadbd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.175250 May 05 14:17:35.703157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1219/2122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:36.444700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:36.445262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:36.451543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.451992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.452756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.453196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.578533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:36.586430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0cbe9e5a-9096-4b5b-8f13-29b3510674ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145638 May 05 14:17:36.586990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 904/2123] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:36 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:36.661948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:36.662588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:36.668873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.669977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.670753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.671185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.719939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:36.720469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:36.726355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.726803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.727710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:36.727988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:36.730140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:36.738597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d0f324a7-3574-4268-bce6-6769c9d22920 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080453 May 05 14:17:36.739154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1220/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:36.856338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:36.864770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f09d3b08-c728-41ba-bd79-e8bac638a5db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149274 May 05 14:17:36.865330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 905/2125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:37.603382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:37.604259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:37.610176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.610635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:37.611406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.611854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:37.754634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:37.755261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:37.761569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.762095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:37.762848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.763885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:37.844246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:37.849426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:37.852646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-904975b4-a73f-4ddd-8630-c6f09f5ae753 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.101860 May 05 14:17:37.855360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 906/2126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:37.860460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6e73719d-3e35-4a83-9b11-cc61630841e4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.260986 May 05 14:17:37.861025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1221/2127] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:37 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:37.880305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:37.880915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:37.886807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.887287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:37.888051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:37.888490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:38.012022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:38.019822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-72fa9c83-a59e-42a5-901d-743a3e1ba730 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143231 May 05 14:17:38.020386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 907/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:38.872045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:38.873227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:38.877263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:38.877965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:38.879736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:38.880156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:38.880926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:38.881350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:38.885144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:38.885669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:38.886569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:38.887011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:38.949696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:38.957713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d52938d4-702c-4ba4-a656-eb28f2a25a12 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091327 May 05 14:17:38.958534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1222/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:39.034064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:39.036489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:39.037118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:39.043419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:39.043893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:39.045245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:39.045691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:39.051526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-35b56a3a-734d-4e21-a558-f56361673d46 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.178410 May 05 14:17:39.052593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 908/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:39.174740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:39.182481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d62fd824-14c7-4cb5-806d-5bb0f655676d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149772 May 05 14:17:39.183047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1223/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:39.975048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:39.975663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:39.982266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:39.982717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:39.983479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:39.983919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:40.042763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:40.051079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2e0cc11-41f9-426d-8dc2-f6607d0c2507 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079922 May 05 14:17:40.051644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 909/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:40.068438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:40.069051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:40.075451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:40.075891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:40.076736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:40.077176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:40.199041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:40.199781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:40.203818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:40.206294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:40.206746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:40.207522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:40.207957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:40.211849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-47d5ca1f-1ce4-4785-a1fe-90c16a0cb34b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147200 May 05 14:17:40.212555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1224/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:40.336375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:40.344694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76c8953b-cac8-439d-b20e-9c0c99ed2f17 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149491 May 05 14:17:40.345262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 910/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:41.068437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:41.069055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:41.075113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.075559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.076298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.076730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.140752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:41.148815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6dd62c7d-67bd-453a-8752-22a3a77a336f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084214 May 05 14:17:41.149391 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1225/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:41.229452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:41.230114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:41.237123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.237581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.238378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.238822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.362068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:41.362697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:41.363872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:41.368953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.369411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.370303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:41.370689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:41.373075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6dc53fca-0a84-4ebb-94c5-777fffa435c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147698 May 05 14:17:41.374062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 911/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:41.507501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:41.518687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ebd677f0-a126-442e-a309-c665ad97c8ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.160400 May 05 14:17:41.521297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1226/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:42.171323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:42.171944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:42.177912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.178487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.179258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.179703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.241230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:42.249562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a4d21c1c-6b36-463c-9f4f-45f78cd6d0d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082084 May 05 14:17:42.250157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 912/2138] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:42.393068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:42.393601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:42.403702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.404172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.404942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.405382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.529480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:42.536549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:42.537169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:42.537740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aaa261b9-d53c-4994-b1e5-8fc3de4202ec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151742 May 05 14:17:42.538342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1227/2139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:42.543113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.543636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.544925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:42.545391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:42.670707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:42.678372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa561bb9-2037-4957-b48b-24918b46642b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145531 May 05 14:17:42.678970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 913/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:43.266093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:43.266708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:43.272733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.273206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.273954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.274423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.336166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:43.344098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88499ab0-ecfe-4539-ad83-4f9b61e50353 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081949 May 05 14:17:43.344666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1228/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:43.555140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:43.555754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:43.562069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.562526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.563296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.563736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.686755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:43.694540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f02ffb14-aeeb-47e4-92df-41f6620996c0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143229 May 05 14:17:43.695105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 914/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:43 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:43.695259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:43.695938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:43.702934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.703385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.704147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:43.704592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:43.833508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:43.841403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b3a91d3-4087-4529-b926-4d9fd2a7afa3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150022 May 05 14:17:43.841969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1229/2143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:44.360710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:44.361259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:44.367257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.367704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.368462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.368902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.430252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:44.438467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1690411d-2285-4d2a-a710-82330ee9adfe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081740 May 05 14:17:44.439023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 915/2144] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:44.712091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:44.712637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:44.718899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.719345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.720094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.720521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.844989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:44.852758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c0eecfe8-e7bc-4614-8eb5-2d1541ffffcb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144583 May 05 14:17:44.853324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1230/2145] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:44 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:44.859292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:44.859905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:44.866349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.866796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.867555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:44.867983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:44.992655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:45.000358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8c70448f-63dc-4f65-814a-7a5580593c57 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145387 May 05 14:17:45.000913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 916/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:45.455322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:45.455968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:45.461884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:45.462378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:45.463140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:45.463577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:45.525206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:45.533651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8429f291-09da-4fc6-a786-bf5ea1cef2c6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082177 May 05 14:17:45.534242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1231/2147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:45.869950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:45.870600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:45.876954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:45.877407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:45.878209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:45.878654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:46.001816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:46.009741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dc56af9b-5de9-428b-8db9-c1001b7373d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143675 May 05 14:17:46.010368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 917/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:45 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:46.017490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:46.018143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:46.024427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:46.031177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:46.031177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:46.031177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:46.150794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:46.158732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf4b5ff1-ec1e-4f5d-ab57-b6987d40794e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145965 May 05 14:17:46.159295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1232/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:46.550188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:46.550736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:46.556709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:46.557171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:46.557942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:46.558413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:46.620411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:46.628643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-56780d24-504b-44f7-98cf-8022c868bb87 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082418 May 05 14:17:46.629196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 918/2150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:47.027467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:47.034660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:47.035070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.035527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.036297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.036741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.164476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:47.173181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef8b41d3-6092-4e2f-bdc8-987403972934 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149611 May 05 14:17:47.173751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1233/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:47.175858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:47.176487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:47.182960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.183412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.184188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.185142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.308980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:47.317377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4335d984-8d1b-4602-b865-eb933e48b72c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145399 May 05 14:17:47.317972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 919/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:47.644666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:47.645276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:47.651244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.651691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.652442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:47.652868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:47.713891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:47.722169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-06c0b1a0-a908-4ec2-a75e-5e81cefa5076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081306 May 05 14:17:47.722723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1234/2153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:48.191002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:48.191629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:48.197971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.198456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.199226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.199670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.323182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:48.331529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c52489b4-0b1d-4d50-9ed2-039e241697a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144349 May 05 14:17:48.332096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 920/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:48.335014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:48.335630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:48.342643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.343098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.343862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.344301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.467835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:48.475681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-645f77b0-c834-47e8-9629-292b570e8e74 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144516 May 05 14:17:48.476242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1235/2155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:48.739217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:48.739767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:48.745670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.746157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.746922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:48.747357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:48.809060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:48.816881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-805b3083-8792-4a95-b4c6-45811d8a60ab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081523 May 05 14:17:48.817439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 921/2156] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:49.348386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:49.348936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:49.355571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.356027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.357305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.357746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.482931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:49.491001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5582461c-3ffe-4515-a2e7-e14fbb6f106c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146540 May 05 14:17:49.491572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1236/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:49.492646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:49.493271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:49.499141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.499594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.500364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.500804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.622550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:49.630329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-268a8223-fab2-46d0-857e-296c38f5f483 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.141644 May 05 14:17:49.630894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 922/2158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:49.833582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:49.834259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:49.840188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.840641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.842044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:49.842473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:49.903522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:49.911872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84d46b9d-fa71-4b5b-9323-71fea7ad3166 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082092 May 05 14:17:49.912426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1237/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:50.507730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:50.508335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:50.515189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.515635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.516388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.516821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.640430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:50.647084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:50.647703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:50.648179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fd09be1f-9bfd-4131-9e0d-e3f7cc2d4c14 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144322 May 05 14:17:50.648737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 923/2160] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:50 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:50.654669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.655127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.655887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.656361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.783013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:50.790810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cef8f2f9-4010-4b6d-95c3-506b3b1e45e7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147561 May 05 14:17:50.791368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1238/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:50.928501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:50.929124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:50.935566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.936019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.936784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:50.937224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:50.999035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:51.006802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3adc1075-aaee-4378-b1fd-b29e14576a82 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082220 May 05 14:17:51.007367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 924/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:51.665652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:51.666327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:51.673264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:51.673714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:51.674506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:51.674951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:51.799153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:51.806926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f3dc31c9-3dd2-4e68-bec3-c613138dc368 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145146 May 05 14:17:51.807490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1239/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:51.807639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:51.808320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:51.814807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:51.815251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:51.816324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:51.816464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:51.938573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:51.946264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2798f08d-1bc2-488d-9e82-419547c38dcd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142486 May 05 14:17:51.946824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 925/2164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:52.023917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:52.024556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:52.031151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.031608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:52.032379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.032822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:52.094691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:52.102770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db0a4d1b-e792-4742-807d-b63ae42e230e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082614 May 05 14:17:52.103348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1240/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:52.823990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:52.824603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:52.831491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.831941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:52.832702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.833140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:52.956979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:52.962918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:52.963568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:52.965091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ac58617c-c4e3-40ad-9293-6010b8628140 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144945 May 05 14:17:52.965661 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 926/2166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:52.970576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.971031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:52.971815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:52.973496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:53.108452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:53.116362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d821b24f-07e6-4f32-ab6e-46f7def3c190 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.157400 May 05 14:17:53.116931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1241/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:53.119300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:53.119914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:53.126299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:53.126748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:53.127512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:53.127945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:53.195631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:53.203574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a03db66b-a231-4d19-ab3a-c7fbf1c782e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088067 May 05 14:17:53.204128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 927/2168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:53.987084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:53.987692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:53.994038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:53.994508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:53.995258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:53.995688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:54.121749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:54.129550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4f33f29e-bb6b-430b-8bb5-aec0c4a520fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146377 May 05 14:17:54.130130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1242/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:53 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:54.133759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:54.134405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:54.140738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:54.141195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:54.141969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:54.142437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:54.220752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:54.221380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:54.227442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:54.227892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:54.228653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:54.229349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:54.277725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:54.286139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bdf71ccb-ab76-4315-aa04-84ca8f307b0f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.156229 May 05 14:17:54.286715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 928/2170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:54.297219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:54.305095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2fd640e9-4ba1-4465-9a71-14d3dcb3238f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088239 May 05 14:17:54.305650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1243/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:55.146482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:55.147136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:55.153409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.153861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.154668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.155110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.281572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:55.290262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0b4876a9-65ef-4336-8b47-4e5a041573fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147658 May 05 14:17:55.290829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 929/2172] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:55.302832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:55.303481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:55.310483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.310939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.311697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.312136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.321110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:55.321717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:55.327760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.328204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.328999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:55.340130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:55.409873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:55.417733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-28152380-7b70-4d01-8a58-b72595e60f0d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.100342 May 05 14:17:55.418323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 930/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:55.466549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:55.474314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2f59945d-8b8f-4e2b-910c-4bc12dd174af tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.175287 May 05 14:17:55.474871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1244/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:56.308006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:56.308650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:56.315125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.315582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.316344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.316782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.434833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:56.435449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:56.441751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.442409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.443172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.443608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.447882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:56.455690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aedc059e-6fa0-4323-af24-90d476642217 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151553 May 05 14:17:56.456261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 931/2175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:56.491887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:56.492495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:56.498359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.498808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.499563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:56.499999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:56.504354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:56.512334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-11ecbcff-6ca0-4285-b889-be70f65f0f7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081354 May 05 14:17:56.513403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1245/2176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:56.890590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:56.898448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-105feccb-462a-4853-93cd-617a2c6b552b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.410245 May 05 14:17:56.899022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 932/2177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:57.472678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:57.473288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:57.479945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.480390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:57.481144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.482132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:57.528583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:57.529218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:57.535477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.535925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:57.536684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.537116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:57.608260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:57.615937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5981d2de-cf69-40b5-9bba-a2b6ebb89291 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091245 May 05 14:17:57.616507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 933/2178] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:57.630713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:57.638552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fffb349e-ad85-4bb6-b6cf-276779d6fc18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.169770 May 05 14:17:57.639103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1246/2179] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:57 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:57.915074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:57.915697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:57.922338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.922793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:57.923594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:57.924044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:58.056353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:58.064147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-17b77f96-871c-498f-8f4b-3ef6dbb3f6d7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152937 May 05 14:17:58.064711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 934/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:58.632807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:58.633425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:58.639479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:58.639936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:58.640702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:58.641147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:58.655878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:58.656523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:58.662811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:58.663265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:58.664036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:58.664475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:58.704910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:58.712816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8db3a5a7-6934-4c7a-b8a0-52f4d894c5b3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084060 May 05 14:17:58.713390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1247/2181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:58.794957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:58.802837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4e1e5a29-5899-4cb1-aba6-046ded8a8e72 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151299 May 05 14:17:58.803405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 935/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:17:59.080824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:59.081437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:59.087583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.088068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.088853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.089295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.220534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:59.228300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a823fe18-c9f1-4e16-887c-e7e5039d5565 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151270 May 05 14:17:59.228859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1248/2183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:59.730249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:59.730872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:59.737250 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.737709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.738502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.738946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.799421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:59.807176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-58bd4bcd-77f3-4235-bd4a-2d6830272d7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081146 May 05 14:17:59.807744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 936/2184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:17:59.819652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:17:59.820271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:17:59.827177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.827631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.828396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:17:59.828837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:17:59.952668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:17:59.960468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4bf5fadc-1c03-430f-890d-9e094d9fcbd9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144609 May 05 14:17:59.961052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1249/2185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:17:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:00.245973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:00.246619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:00.253067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.253513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:00.254303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.254742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:00.553857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:00.562122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1c8a9fa5-2e5e-4c38-956e-b3823613d422 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.319926 May 05 14:18:00.562682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 937/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:00.823336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:00.823866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:00.830402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.830856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:00.831618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.832054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:00.891255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:00.898983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-261f9cde-c0ca-4859-a8d4-a293facdb826 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079665 May 05 14:18:00.899536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1250/2187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:00.977391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:00.978008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:00.985174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.985629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:00.986446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:00.986886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:01.112582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:01.120333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-63594735-6b34-45d8-8c87-c8c9079a50b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146769 May 05 14:18:01.120883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 938/2188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:00 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:01.580100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:01.580708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:01.586664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:01.587110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:01.587866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:01.588303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:01.711794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:01.719484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d25c92ee-2949-4995-a3d1-579a24e74834 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143263 May 05 14:18:01.720040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1251/2189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:01.916054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:01.916606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:01.922994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:01.923454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:01.924224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:01.924668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:01.983664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:01.991885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b606baa2-fdc2-47a3-b458-ea139f577622 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079726 May 05 14:18:01.992444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 939/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:02.137907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:02.138574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:02.145009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:02.145467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:02.146325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:02.146769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:02.273240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:02.281630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4c5c23b1-001d-40a9-ac2d-b0b66c867a42 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147641 May 05 14:18:02.282223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1252/2191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:02.736100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:02.736738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:02.742664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:02.743111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:02.743867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:02.744304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:02.866411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:02.874187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e555eba-042b-4e2d-a3f7-a7a426251a8b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.141845 May 05 14:18:02.874735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 940/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:03.009213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:03.009777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:03.016385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.016832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:03.017588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.018048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:03.077206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:03.085184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-772ace1e-b6d0-4971-b938-b1805ed5ff23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079933 May 05 14:18:03.085737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1253/2193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:03.299171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:03.299715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:03.305946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.306430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:03.307192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.307631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:03.433767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:03.442229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b16bec79-e038-4ae2-a1ee-425b1363ba1a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147018 May 05 14:18:03.442787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 941/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:03.891088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:03.891723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:03.898222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.898671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:03.899425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:03.899858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:04.023938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:04.032370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d680d5d4-f20e-46f7-9073-bbedbc303caf tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145156 May 05 14:18:04.032941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1254/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:04.104627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:04.104627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:04.110635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:04.111092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:04.111862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:04.112304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:04.171315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:04.178863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e7c91581-1c5d-440a-964a-893228ac9ab7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080978 May 05 14:18:04.179420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 942/2196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:04.460120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:04.460651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:04.466645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:04.467094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:04.467845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:04.468280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:04.596168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:04.603901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a1fcf4a6-d742-48df-8c85-249431eb73db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147714 May 05 14:18:04.604730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1255/2197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:04 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:05.049538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:05.050198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:05.056538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.056988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.057752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.058225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.184769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:05.192774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9005c339-3c6f-4245-b846-5428004ac219 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147080 May 05 14:18:05.193321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 943/2198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:05.196142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:05.196794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:05.203139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.203592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.204361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.204799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.268344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:05.276422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef3fc3bf-bf08-4b76-ac00-f569580977d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084257 May 05 14:18:05.277158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1256/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:05.620641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:05.621284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:05.627211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.627655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.628554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:05.628985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:05.763946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:05.771966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1d2dc7e1-5de4-48eb-855d-d15921fe4ef4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.155234 May 05 14:18:05.772528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 944/2200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:05 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:06.209473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:06.210144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:06.216536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.216988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.217746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.218217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.293622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:06.294767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:06.300801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.301256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.302049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.302497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.352313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:06.361421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8fa91966-0655-4c54-9509-001b20d9d390 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.155721 May 05 14:18:06.361935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1257/2201] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:06.368600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:06.385134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-218b173b-8375-4311-ac8b-ee053cbca227 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087140 May 05 14:18:06.385134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 945/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:06.789715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:06.790332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:06.796841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.797281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.798053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:06.798491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:06.923232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:06.930805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-958ed2a3-046f-44f3-b625-b209e7f6500d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145111 May 05 14:18:06.931356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1258/2203] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:07.379021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:07.379638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:07.386091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.386540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:07.388081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.388081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:07.393154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:07.393776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:07.400103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.400549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:07.401362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.401802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:07.480883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:07.489301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e36dabb4-c4d5-4b97-8059-101a6faa0d92 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.100074 May 05 14:18:07.489864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1259/2204] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:07.540012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:07.548314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ce460c0-7b0e-425d-8263-e4020b1f9206 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.173243 May 05 14:18:07.548865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 946/2205] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:07.947764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:07.948298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:07.954236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.954684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:07.955439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:07.955873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:08.085239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:08.092985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1f4166fe-9cdc-4c1a-a2fb-cbf3ad18933f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149132 May 05 14:18:08.093546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1260/2206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:07 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:08.505084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:08.505720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:08.512126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:08.512576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:08.513839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:08.514305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:08.564608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:08.565224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:08.571702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:08.572378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:08.572918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:08.573356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:08.574339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:08.582709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-00eb460f-6957-4774-a421-367d9be4279f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081482 May 05 14:18:08.583273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 947/2207] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:08.700710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:08.708486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-03122536-7e5b-491d-938c-c2147a104766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147727 May 05 14:18:08.709052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1261/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:09.110523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:09.111138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:09.117120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.117571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.118389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.118847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.245358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:09.253782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-144b3772-55ce-482b-a609-329010775821 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147249 May 05 14:18:09.254379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 948/2209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:09.600081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:09.600708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:09.607867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.608320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.609083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.609528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.670787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:09.678477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb1eeaa9-7c96-477d-8203-1a244778cacd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082241 May 05 14:18:09.679041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1262/2210] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:09.725211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:09.725830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:09.733114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.733596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.734390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:09.734829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:09.860266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:09.868003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f3859d2d-b15d-475d-bb9a-05cb8ef97956 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146649 May 05 14:18:09.868560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 949/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:10.271328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:10.271861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:10.277897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.278466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:10.279241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.279680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:10.413199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:10.421638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d139a3d0-818d-43d8-9105-0a19694e1b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154260 May 05 14:18:10.422227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1263/2212] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:10 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:10.695325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:10.695941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:10.701897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.702380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:10.703149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.703598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:10.764483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:10.772199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0c8291e6-6e71-471d-b16a-31e5a2064b22 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080763 May 05 14:18:10.772762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 950/2213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:10.884732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:10.885316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:10.892147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.892635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:10.893399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:10.893840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:11.021340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:11.029657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-49857368-dd12-4372-b8ab-bf407096c9ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148833 May 05 14:18:11.030250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1264/2214] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:11.438983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:11.439593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:11.445618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:11.446091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:11.446850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:11.447284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:11.574323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:11.582195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-94b696e8-9dbc-4017-b6b2-1e87ccecceb7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147481 May 05 14:18:11.582749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 951/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:11 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:11.788770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:11.789312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:11.795380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:11.795834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:11.796600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:11.797038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:11.861707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:11.870434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c6ad69bb-d7dd-46ca-8e0c-7cfa378beff1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085466 May 05 14:18:11.871030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1265/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:12.046961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:12.047537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:12.053967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.054445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.055239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.055674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.179865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:12.188049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a4610200-2f6a-4639-bdba-756b3bf5bbbb tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145152 May 05 14:18:12.188603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 952/2217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:12.599022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:12.599631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:12.606276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.607235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.607989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.608423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.737405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:12.745212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-100d48af-cf22-4447-a2af-7950264b21bd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150012 May 05 14:18:12.745778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1266/2218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:12 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:12.887538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:12.888112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:12.893957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.894432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.895191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:12.895627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:12.958128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:12.966653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-46685828-a10b-43f7-ae18-852795c07a65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082525 May 05 14:18:12.967216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 953/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:13.205587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:13.206138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:13.212034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.212474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:13.213232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.213667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:13.345836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:13.353665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-334f4397-f9d4-4bb1-b253-79705059308e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151994 May 05 14:18:13.354523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1267/2220] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:13.761151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:13.761761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:13.768779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.769255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:13.770063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.770500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:13.894247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:13.901963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a333c818-7d86-45a0-91e5-9af4504b8b04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144682 May 05 14:18:13.902548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 954/2221] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:13.983955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:13.984582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:13.990992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.991448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:13.992254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:13.992726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:14.055159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:14.063749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c1c759c5-376c-4624-8816-259dd3048f85 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084512 May 05 14:18:14.064314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1268/2222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:14.370363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:14.370977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:14.377047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:14.377495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:14.378287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:14.378723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:14.501258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:14.509065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0f0790be-f854-40ab-9a28-c083c063ef2f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142646 May 05 14:18:14.509621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 955/2223] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:14.918985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:14.919610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:14.925568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:14.926040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:14.926818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:14.927261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:15.050695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:15.058463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0fe0e523-ec92-450d-8eb1-498f39b3d45a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143384 May 05 14:18:15.059036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1269/2224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:14 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:15.080857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:15.081472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:15.087801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:15.088256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:15.089028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:15.089468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:15.152946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:15.160597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7a508f10-ec1f-480e-a274-170dadf5c0da tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083653 May 05 14:18:15.161156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 956/2225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:15.526496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:15.527230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:15.533251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:15.533702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:15.534505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:15.534954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:15.660555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:15.668460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c79bb34-aae0-4ff0-a96e-105a4ba99aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145842 May 05 14:18:15.669808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1270/2226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:16.076724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:16.077337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:16.083245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.083792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.084444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.084879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.176485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:16.177096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:16.183397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.183843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.184604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.185036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.212470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:16.221096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-839bfc2d-97b7-4769-b04c-807c637baa63 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148805 May 05 14:18:16.221662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 957/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:16 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:16.250148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:16.258005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88f36ccc-cf77-4bf6-bf2c-2a511af66250 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085370 May 05 14:18:16.258587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1271/2228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:16.688327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:16.688948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:16.694970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.695426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.696194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:16.696637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:16.821287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:16.829081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1f37d8fb-065c-4f87-b634-27889df2879b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145058 May 05 14:18:16.829683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 958/2229] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:17.238467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:17.239090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:17.245427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.245883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.246677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.247119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.279342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:17.279954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:17.286408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.286865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.287640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.288082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.360314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:17.368148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d6d3f39a-573d-4064-bef0-26b0eb0375ca tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093276 May 05 14:18:17.368722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 959/2230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:17.404169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:17.412126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b6f5dba-3bf6-4113-9284-8750b1ad4f88 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.177557 May 05 14:18:17.412724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1272/2231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:17.846112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:17.846732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:17.852659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.853115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.853879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:17.854604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:17.977971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:17.986599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e15a43a-830c-4634-9854-e755029b48b0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144367 May 05 14:18:17.987158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 960/2232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:18.385323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:18.385870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:18.392924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:18.393373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:18.394166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:18.394603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:18.429976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:18.430609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:18.437171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:18.437616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:18.438420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:18.438857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:18.454575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:18.462494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5dbf16dd-b549-4c8e-bbcf-c01b64ecb7be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081050 May 05 14:18:18.463143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1273/2233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:18.575660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:18.575950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f8ff2abb-5098-4933-bfec-6948805e7d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149047 May 05 14:18:18.576515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 961/2234] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:18 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:19.004616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:19.005267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:19.011219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.011676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.012440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.012890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.138175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:19.145882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-97a4e990-930f-46a6-8b93-4bc6d0cfa004 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145229 May 05 14:18:19.146476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1274/2235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:19.479985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:19.480594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:19.487301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.487747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.488506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.488940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.547751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:19.555440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d7003b29-cca5-4ba0-9568-517d66563ac9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079543 May 05 14:18:19.555992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 962/2236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:19.593056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:19.593740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:19.600055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.600511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.601270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:19.601707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:19.731270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:19.739587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-15c040bc-117c-4760-8ea9-8959eb19c4b2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150932 May 05 14:18:19.740146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1275/2237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:19 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:20.162791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:20.163398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:20.169381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.169833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.170638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.171076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.293552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:20.301353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e7f6e178-e17a-4ed0-9269-1e5d016556df tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142481 May 05 14:18:20.301916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 963/2238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:20.571750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:20.572284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:20.578234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.578682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.579435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.579872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.639119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:20.646793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0ce5df27-94a0-4908-8921-7b36bc9bbced tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078945 May 05 14:18:20.647350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1276/2239] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:20.756567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:20.757187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:20.763515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.764001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.764804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:20.765245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:20.891087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:20.898816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e4659644-d50c-46f8-aa1b-dc8b6bbabb3e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146383 May 05 14:18:20.899376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 964/2240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:21.318890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:21.319502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:21.328751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.329213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:21.330036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.330615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:21.465361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:21.474202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d8d68255-ec31-4f2e-b9ad-4778bdd2c53c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.159181 May 05 14:18:21.474765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1277/2241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:21.662922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:21.663542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:21.669506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.669956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:21.670747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.671190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:21.735082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:21.742855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bc001c98-8802-4797-9476-0bd1c7ba84ba tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083840 May 05 14:18:21.743417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 965/2242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:21.916060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:21.916703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:21.923591 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.923987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:21.924736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:21.925169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:22.052993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:22.060682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2125d7ee-dd13-4c24-ba7a-001891552faa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148479 May 05 14:18:22.061245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1278/2243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:21 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:22.490887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:22.491505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:22.498354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:22.498814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:22.499633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:22.500075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:22.624270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:22.632071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec1918dd-c1d4-434d-8439-e8568f2448d9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145075 May 05 14:18:22.632637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 966/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:22.759942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:22.760479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:22.766946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:22.767397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:22.768149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:22.768581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:22.830977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:22.838769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-657152ad-619c-42b1-b5f8-990c41b0b8bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082727 May 05 14:18:22.839329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1279/2245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:23.079789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:23.080400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:23.086339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.086790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.087548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.087984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.211608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:23.219492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6e738eae-fab6-413b-9a3a-3f307a7b7e6b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144795 May 05 14:18:23.220050 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 967/2246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:23 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:23.647911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:23.648526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:23.655135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.655595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.656412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.656861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.781109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:23.789013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8edc87f0-d3ab-4737-91eb-eef42c0f2b05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144958 May 05 14:18:23.789587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1280/2247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:23.856607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:23.857751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:23.864243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.864688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.865443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:23.865877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:23.929129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:23.937173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-120ccaa8-5152-4134-93a1-98567efdd130 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084622 May 05 14:18:23.938620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 968/2248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:24.237056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:24.237606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:24.243562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.244004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:24.244754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.245261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:24.368237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:24.375953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f1bcf83-2a7f-4e6e-992c-a9d3d15d2ba1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143437 May 05 14:18:24.376542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1281/2249] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:24 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:24.806590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:24.807207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:24.813683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.814157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:24.814914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.815478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:24.937742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:24.945470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f74aaa46-7742-4bea-bc15-bb1eaf39e08a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142813 May 05 14:18:24.946047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 969/2250] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:24.955198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:24.955817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:24.962156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.962611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:24.963373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:24.963808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:25.026739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:25.035167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b3e35164-fd53-4500-a12b-ca120313c38b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084372 May 05 14:18:25.035730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1282/2251] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:25.392602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:25.393131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:25.399135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:25.399584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:25.400341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:25.400772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:25.524002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:25.532287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8bce32d3-3576-4019-bc79-c660a16cf5fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143593 May 05 14:18:25.532877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 970/2252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:25.962943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:25.963558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:25.970613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:25.971067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:25.971828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:25.972298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:26.051893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:26.052558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:26.058917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:26.059373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:26.060138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:26.061204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:26.108807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:26.115328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-653d8b3d-16a6-4cb2-b04b-a349ec45bfef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.156244 May 05 14:18:26.115899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1283/2253] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:26.126741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:26.134612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c2db6e11-032e-4689-87f9-69b06c09f180 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086478 May 05 14:18:26.136132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 971/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:26.549082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:26.549698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:26.555807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:26.556282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:26.557041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:26.557470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:26.680036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:26.687799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2ac76bc2-acfe-4e26-9006-1129eb4706c5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142649 May 05 14:18:26.688366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1284/2255] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:26 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:27.132914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:27.133524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:27.140099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.140548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.141304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.141738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.150877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:27.152432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:27.158723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.159182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.159951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.160396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.236781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:27.244743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e8490539-91be-49b1-9454-c07a6428b6a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.097537 May 05 14:18:27.245155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1285/2256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:27.298860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:27.306679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6341d2fb-672c-4ecb-9f34-b70fcbf02684 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.177601 May 05 14:18:27.307249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 972/2257] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:27.705417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:27.706066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:27.712036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.712511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.713278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:27.713719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:27.839255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:27.847131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bdda4f27-6113-46d1-85ca-d4b09322fc03 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146209 May 05 14:18:27.847705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1286/2258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:28.261240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:28.261851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:28.268239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.268693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:28.269456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.269900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:28.324031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:28.324647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:28.330780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.331239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:28.331630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:28.332009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.332451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:28.345177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-652d3b01-8271-48d0-8657-704d5119b37b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087660 May 05 14:18:28.345760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 973/2259] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:28.463774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:28.472061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9ac5b3f9-d91e-40d5-94b9-92db17eea58d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152110 May 05 14:18:28.472623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1287/2260] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:28.864330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:28.864987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:28.871035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.871492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:28.872263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:28.872738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:29.017793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:29.025919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a4e054b2-c267-4a50-a62e-2b205f8253fd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.165637 May 05 14:18:29.026503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 974/2261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:29.363299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:29.363917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:29.370294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:29.370744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:29.371511 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:29.371952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:29.431292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:29.439243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7f62fde5-b764-4489-a1c3-9972966ab35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079839 May 05 14:18:29.439810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1288/2262] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:29.489325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:29.490187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:29.496556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:29.497012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:29.497787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:29.498262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:29.629449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:29.637652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c4c5fae3-f549-4038-be7b-c7aaa21b66bd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152321 May 05 14:18:29.638764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 975/2263] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:30.044101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:30.045276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:30.051257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.051712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.052473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.052952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.176097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:30.184200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-824b9f35-0396-469a-a476-2d3ad54963f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144011 May 05 14:18:30.184768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1289/2264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:30 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:30.456587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:30.457323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:30.463592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.464039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.464824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.465267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.531383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:30.540233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe581b9b-a4b1-4d2c-b863-122cc7748d71 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087604 May 05 14:18:30.540806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 976/2265] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:30.659451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:30.660090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:30.666587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.667039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.667810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:30.668241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:30.798361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:30.805648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-751f43c1-eaa5-4d8e-aed7-47a7263ea4a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150157 May 05 14:18:30.806257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1290/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:31.200646 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:31.206545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:31.207126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.207583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.208362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.208807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.340907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:31.348705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0611448b-dd0e-4709-bd96-b3ac7c1803e0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.152007 May 05 14:18:31.349273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 977/2267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:31 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:31.556406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:31.556943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:31.562897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.563351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.564122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.564552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.626524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:31.634304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-91500637-604c-4efd-8a44-fd12b9728b8d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081842 May 05 14:18:31.634866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1291/2268] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:31.823316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:31.823856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:31.830803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.831252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.832010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:31.832467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:31.955665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:31.963274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c38f510-a16f-4561-9a85-69203aa228b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143905 May 05 14:18:31.963830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 978/2269] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:32.366611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:32.367143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:32.374091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.374535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:32.375283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.375714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:32.499010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:32.506706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-450d31f8-9854-43ae-a94c-0596716688de tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144131 May 05 14:18:32.507264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1292/2270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:32.651750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:32.652297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:32.659092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.659545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:32.660323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.660763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:32.722805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:32.731041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b8a8bb6e-317e-4aec-95cb-da592799a64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083203 May 05 14:18:32.731610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 979/2271] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:32.980328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:32.980875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:32.987352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.989942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:32.989942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:32.989942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:33.114694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:33.122546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ff115c7d-374d-4ae7-b9d7-6c1212061dfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146490 May 05 14:18:33.123909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1293/2272] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:33.523591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:33.524208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:33.531212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:33.531662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:33.532431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:33.532869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:33.656627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:33.664263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-afa8646a-adc3-40ab-817b-d91464a80972 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144542 May 05 14:18:33.664824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 980/2273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:33 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:33.748752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:33.749372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:33.755791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:33.756245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:33.757003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:33.757443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:33.819583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:33.827913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3d3c71e0-b98e-48c5-a101-2d322362ccf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083580 May 05 14:18:33.828474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1294/2274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:34.140626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:34.141233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:34.147295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.147739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.148494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.148926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.272588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:34.280463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-565aee36-9f7d-48a5-b2b1-67d2a6244c63 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144192 May 05 14:18:34.281019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 981/2275] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:34.681005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:34.681613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:34.687674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.688122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.688880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.689314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.815951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:34.823718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b94912fd-cbff-409e-a107-6db24e4e1c8b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146547 May 05 14:18:34.824293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1295/2276] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:34.846135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:34.846788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:34.853122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.853575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.854653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:34.855099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:34.916717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:34.924400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b2023005-9eac-4097-b893-2d1e2264654a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082735 May 05 14:18:34.924964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 982/2277] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:35.296606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:35.297225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:35.303267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.303726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.304487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.304927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.438356 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:35.446247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6543a0c4-4b20-4272-a1e0-aa56c0955d8d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153456 May 05 14:18:35.446843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1296/2278] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:35.840670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:35.841296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:35.848310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.848878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.849518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.849956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.940647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:35.941431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:35.948070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.948599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.949440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:35.949971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:35.976268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:35.985066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-929d536c-9d43-4e2b-a4e9-eb62570377d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148283 May 05 14:18:35.985644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 983/2279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:36.012977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:36.020754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d02da7f3-2be0-4bbd-8683-015950040623 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084016 May 05 14:18:36.021313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1297/2280] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:36.463929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:36.464620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:36.471124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:36.471580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:36.472352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:36.472797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:36.598152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:36.606390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f880f78e-e14f-4ed6-883d-ec48012095a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146226 May 05 14:18:36.607047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 984/2281] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:37.002752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:37.003371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:37.009815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.010305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.011066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.011504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.038156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:37.040253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:37.049279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.049738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.050554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.050998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.131690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:37.139712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-57a3a6f9-500f-4434-934e-18f9d737c720 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.105659 May 05 14:18:37.140287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 985/2282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:37.163544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:37.172451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1641e104-b609-4d03-8d25-d53fa5f56c34 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.173560 May 05 14:18:37.173010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1298/2283] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:36 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:37.622980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:37.623613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:37.629565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.630035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.630799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:37.631349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:37.757609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:37.765852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d67b8a73-3253-4e21-bd16-6ef7e90262b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146795 May 05 14:18:37.769712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 986/2284] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:38.156504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:38.157116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:38.163465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.163910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.164664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.165098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.190872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:38.191509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:38.197879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.198374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.199142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.199577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.224767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:38.232883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-03b85ee0-13a5-46c2-bbff-3edb8ae8b54b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080245 May 05 14:18:38.233450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1299/2285] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:38.326973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:38.334718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-56571c6e-20eb-47e9-9ee0-ee4d5f4c8ea3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147650 May 05 14:18:38.335286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 987/2286] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:38.782965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:38.783578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:38.790260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.790717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.791513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:38.791953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:38.920757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:38.929597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1211bfd1-fe20-4b3f-a44a-08fc087a16ba tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150479 May 05 14:18:38.930192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1300/2287] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:39.249560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:39.250241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:39.256590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.257044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:39.257817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.258284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:39.317336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:39.325119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1f082215-6ad2-4737-afa1-87288c912118 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079529 May 05 14:18:39.326213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 988/2288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:39.356866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:39.357382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:39.363858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.364320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:39.365114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.365560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:39.491930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:39.499671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6deb87b1-31a5-4787-81d0-98d2f6627ac4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147656 May 05 14:18:39.500246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1301/2289] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:39 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:39.946721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:39.947332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:39.953935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.954409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:39.955166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:39.955599 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:40.078544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:40.086234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-71807a09-b4ea-47ea-9e4b-78a78cf3f126 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143329 May 05 14:18:40.086795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 989/2290] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:40.341623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:40.342276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:40.348313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:40.349612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:40.350589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:40.351036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:40.411888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:40.420717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0d9bbd53-af1e-4ca3-946f-27552d14ebce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082974 May 05 14:18:40.421285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1302/2291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:40.515744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:40.516364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:40.522826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:40.523282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:40.524049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:40.524492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:40.649912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:40.658143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3fbc64f2-eb89-422a-91cf-cb07cfa70997 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146267 May 05 14:18:40.658713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 990/2292] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:41.104302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:41.105178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:41.111882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.112326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.113081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.113512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.238465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:41.246214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ed660f1d-a050-4c23-a210-afe0dc29abc8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145687 May 05 14:18:41.246781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1303/2293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:41.436839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:41.437377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:41.443548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.444008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.444808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.445257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.504689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:41.512813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-793f2468-dd02-4d7f-a5e4-3552b4649342 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079954 May 05 14:18:41.513895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 991/2294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:41.723402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:41.723947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:41.730700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.731171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.731932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:41.732372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:41.866826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:41.875386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-821f7635-e46f-4edb-a4f2-4014c4aa531f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.155916 May 05 14:18:41.876156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1304/2295] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:42.263056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:42.263673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:42.270101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.270556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:42.271318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.271755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:42.394618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:42.402444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a6092a3b-6d97-4711-a5aa-485e904289db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143265 May 05 14:18:42.403019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 992/2296] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:42.530710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:42.531325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:42.537200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.537654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:42.538447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.538888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:42.600888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:42.609398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a43dafb5-7f3c-4585-ae76-8904facc3d8e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082559 May 05 14:18:42.609962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1305/2297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:42.892702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:42.893327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:42.899366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.899820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:42.900592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:42.901039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:43.028634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:43.036909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6b1ca4f2-408d-4ddc-8ad9-63cf571f95df tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148101 May 05 14:18:43.037481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 993/2298] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:43.418577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:43.419230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:43.425565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:43.426042 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:43.426802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:43.427245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:43.550590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:43.558347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f234d5aa-af27-4363-9eb7-a3aaa54a9b5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143567 May 05 14:18:43.558917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1306/2299] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:43.626475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:43.627099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:43.633411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:43.633868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:43.634682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:43.635125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:43.699313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:43.708109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3dbf755e-11c4-49a2-9f3a-a230fa5c3d53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085998 May 05 14:18:43.708674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 994/2300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:44.054120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:44.054650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:44.061327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.061782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.062573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.063014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.186644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:44.194479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b6c8fc57-d191-429b-a59d-1cbb26349f51 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144442 May 05 14:18:44.195049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1307/2301] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:44 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:44.576344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:44.576958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:44.582952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.583408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.584178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.584621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.707332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:44.715084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5d255773-6539-4a90-82c6-5f2652ff3677 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143109 May 05 14:18:44.715639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 995/2302] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:44.724526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:44.725145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:44.731803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.732258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.733020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:44.733460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:44.794994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:44.802719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d23ce4bb-d284-462e-a1a6-0ea08791dd7d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082037 May 05 14:18:44.803287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1308/2303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:45.211578 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:45.212188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:45.218638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.219084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.219834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.220266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.363408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:45.372885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0310f9ab-854e-4f99-9113-6134c7281dfe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.165142 May 05 14:18:45.373464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 996/2304] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:45 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:45.732697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:45.733237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:45.739610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.740096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.740866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.741308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.819805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:45.820423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:45.826766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.827221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.828029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:45.828472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:45.877609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:45.885538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aecb1d6b-3d7c-4bcc-8dd2-0b6fcef2aaa1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.157662 May 05 14:18:45.886124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1309/2305] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:45.896513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:45.905055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5fecc51-890a-4050-8edf-4a631d9bc230 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.089319 May 05 14:18:45.905610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 997/2306] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:46.390450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:46.390982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:46.396952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.397432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:46.398282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.398725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:46.521629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:46.529828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-366df722-3624-4225-8df4-f9f473bc96ea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143538 May 05 14:18:46.530410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1310/2307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:46 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:46.902545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:46.903167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:46.910129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.910583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:46.911350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.911788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:46.921424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:46.922056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:46.928306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.928765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:46.929535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:46.929978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:47.007691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:47.016537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f4502332-8f49-4e52-97f3-46099f5a7076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.098852 May 05 14:18:47.017326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1311/2308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:47.313121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:47.321011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-718079e3-a429-4381-bf0e-2ed81348784f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.422370 May 05 14:18:47.321575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 998/2309] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:47.547341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:47.547943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:47.553955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:47.554445 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:47.555211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:47.555650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:47.679190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:47.687597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dba68bf8-eadd-42e3-94cf-77e1cf237093 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144686 May 05 14:18:47.688166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1312/2310] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:48.033363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:48.033902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:48.040501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.040949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.041717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.042193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.102660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:48.111764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c6332af0-6e9f-408e-b9c4-a2cbd04a1b37 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082966 May 05 14:18:48.112326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 999/2311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:48.338508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:48.339125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:48.346189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.346643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.347406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.347847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.473815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:48.482843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c14c178-1aa2-42a2-9138-4150da39a663 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147177 May 05 14:18:48.483410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1313/2312] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:48.704334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:48.704951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:48.710932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.711385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.712151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:48.712589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:48.985384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:48.985384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-070a3e15-5901-4368-af0c-3ed1fb07cdbf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146550 May 05 14:18:48.985384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1000/2313] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:49.128671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:49.129284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:49.135240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.135681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.136439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.136873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.195916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:49.204415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9cddf6b6-5e57-4476-932b-37e2f0970438 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079823 May 05 14:18:49.205003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1314/2314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:49.500455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:49.501071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:49.507025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.507480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.508252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.508691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.633919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:49.642244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d6907de1-ee28-4bc5-9c25-16f1b2fd450c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146427 May 05 14:18:49.642810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1001/2315] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:49.865496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:49.866132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:49.873044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.873487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.874269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:49.874703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:49.998707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:50.006444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-697d778f-5d54-436f-9a2b-9bc04d9640da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144720 May 05 14:18:50.007001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1315/2316] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:50.221514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:50.222082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:50.228061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:50.228516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:50.229280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:50.229978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:50.292758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:50.301147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-20963cf6-dc26-4b37-8ea9-597f7ea41724 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083549 May 05 14:18:50.301731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1002/2317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:50.659672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:50.660294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:50.666311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:50.666765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:50.667526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:50.667967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:50.790616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:50.798394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7823d69e-7088-484c-a197-94edee41ded2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142579 May 05 14:18:50.798957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1316/2318] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:51.023752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:51.024300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:51.031222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.031681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.032457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.032897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.156427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:51.164196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-16a453e1-c343-4586-886d-95fe8fecd417 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144393 May 05 14:18:51.164763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1003/2319] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:51.318032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:51.318577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:51.324923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.325885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.326690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.327131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.390693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:51.398908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-244d2648-cfb7-4cdc-a361-a4ddb66547fb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084893 May 05 14:18:51.399481 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1317/2320] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:51.816089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:51.816707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:51.822710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.823159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.823924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:51.824359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:51.946168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:51.954633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75ddff0f-2d55-466e-a716-0c0c8eca9467 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142457 May 05 14:18:51.955207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1004/2321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:52.181937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:52.182583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:52.188605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.189066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:52.189827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.190297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:52.312906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:52.320678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b69cb88-4aee-41c9-ad2a-a45db47bd783 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142632 May 05 14:18:52.321251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1318/2322] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:52.417483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:52.418036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:52.424343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.424788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:52.425544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.425977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:52.497651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:52.505401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8fd5fb42-06e5-4d93-8794-49ef8ad50bd9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091862 May 05 14:18:52.505953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1005/2323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:52.972422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:52.973065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:52.980021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.984982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:52.984982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:52.984982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:53.107018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:53.114820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a50656a0-44c1-4c84-998f-34cfc3f4e955 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146263 May 05 14:18:53.115378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1319/2324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:53.337422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:53.338065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:53.344033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:53.344489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:53.345261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:53.345705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:53.470687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:53.478394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c11bc870-95d2-4ad2-84ab-5039ff0b82d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144842 May 05 14:18:53.478956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1006/2325] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:53 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:53.522546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:53.523221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:53.529259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:53.529714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:53.530513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:53.530956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:53.592802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:53.600587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-89fa60ff-94a3-4620-9141-17af9fff767c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081839 May 05 14:18:53.601183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1320/2326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:54.132629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:54.133249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:54.139212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.139665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.140432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.140868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.266487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:54.274221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5036e868-dfe9-4db9-bc42-4195cf550a85 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145410 May 05 14:18:54.274777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1007/2327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:54.495943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:54.496483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:54.502982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.503427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.504180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.504612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.617346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:54.618109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:54.624995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.625515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.626304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:54.626736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:54.630561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:54.639077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dbbc1d44-44b8-417e-824c-9bf3c5414e9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146362 May 05 14:18:54.639649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1321/2328] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:54.689020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:54.696730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4a7a2ef8-5e75-4d66-9ac4-de03d64d353e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083242 May 05 14:18:54.697287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1008/2329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:55.291285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:55.291924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:55.298378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.298828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.299631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.300070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.432976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:55.440752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5794beba-5a0e-4754-8a18-983f603a7d6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153230 May 05 14:18:55.441309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1322/2330] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:55.656927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:55.657476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:55.663914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.664362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.665121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.665559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.714321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:55.714936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:55.722152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.729316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.729316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:55.729316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:55.800867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:55.808601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b75ecf27-69de-4408-9091-532709e0e055 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.098486 May 05 14:18:55.809161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1323/2331] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:55.821333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:55.829719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e9a3aaaa-4667-4ee2-84c0-a0cf8e3f34cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.177543 May 05 14:18:55.830309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1009/2332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:56.457400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:56.457948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:56.464043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.464504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.465270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.465712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.590154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:56.598713 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2fe30b20-5d1c-48cd-a29a-7595a302db15 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145233 May 05 14:18:56.599294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1324/2333] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:56.825389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:56.826548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:56.832905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.833350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.834133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.834569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.847106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:56.847754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:56.854792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.855242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.856000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:56.856435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:56.897173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:56.905661 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-94fd52c1-7f26-4a0d-9056-76bd2d8aed05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084125 May 05 14:18:56.906256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1010/2334] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:56.991315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:56.999036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a5f6398-cc2b-494c-a960-df7f2a470dd2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.155833 May 05 14:18:56.999586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1325/2335] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:18:57.615990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:57.616608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:57.622524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:57.623525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:57.624288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:57.624726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:57.750467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:57.758325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3081dc37-8ee6-4bdb-8a09-3c053c0fb259 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146206 May 05 14:18:57.758887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1011/2336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:57.922345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:57.922905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:57.929252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:57.929699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:57.930485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:57.930918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:57.990773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:57.999161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d01952fa-bd96-4bc2-8bb6-e74c601afea9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080815 May 05 14:18:57.999709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1326/2337] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:58.015883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:58.016529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:58.023427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:58.023882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:58.025298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:58.025746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:58.156195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:58.163932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a7ec851e-1ac0-4188-8bd9-a0a2688ba7b0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151933 May 05 14:18:58.164501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1012/2338] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:58.775883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:58.776504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:58.782374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:58.784726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:58.784726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:58.784726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:58.909314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:58.917124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d29d7a21-f93d-47ef-91c0-b12d189cd7f5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145306 May 05 14:18:58.917688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1327/2339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:59.015857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:59.016483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:59.022558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.023023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:59.023798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.024244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:59.084067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:59.092428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83cec36a-df8b-4da9-aa9c-e8bc414fe051 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080433 May 05 14:18:59.092999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1013/2340] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:59.180858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:59.181472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:59.187471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.187918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:59.188666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.189099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:59.319756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:18:59.327538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d6c6fc48-7601-49ec-8040-94ecdb99d6b8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150498 May 05 14:18:59.328105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1328/2341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:18:59.934506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:18:59.935167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:18:59.941097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.941552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:18:59.942360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:18:59.942804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:00.066183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:00.073966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-230e4cfb-e3d6-40a3-9e71-670774daffb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143355 May 05 14:19:00.074557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1014/2342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:18:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:00.109427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:00.110125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:00.116698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:00.117148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:00.117909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:00.118385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:00.177730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:00.185607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5f57864d-4968-44c2-9566-ef2ab4aa7513 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080822 May 05 14:19:00.186132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1329/2343] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:00.345120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:00.345734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:00.351714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:00.352167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:00.352937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:00.353375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:00.480671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:00.488709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a6593e1-7926-4e1e-af15-98f454e547cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148202 May 05 14:19:00.489260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1015/2344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:00 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:01.090968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:01.091624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:01.097844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.098327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.099091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.099526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.202674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:01.203297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:01.209688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.210173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.210950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.211389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.225413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:01.233944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-57a1cc48-ecec-4d00-8639-a4f350f0ae3d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146907 May 05 14:19:01.234547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1330/2345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:01.280736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:01.290651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df1deb5f-4f83-4976-8cda-740c855315f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091840 May 05 14:19:01.291226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1016/2346] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:01.504697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:01.505230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:01.511462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.511915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.512673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:01.513111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:01.642635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:01.650480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38494671-9580-4f24-9cd8-91e3a6cf45b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149692 May 05 14:19:01.651046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1331/2347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:02.250770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:02.251390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:02.257731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.258222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.258992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.259432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.309545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:02.310332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:02.316480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.317050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.317819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.318285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.389612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:02.397424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-95534fda-b759-432b-b02b-4f1630646a83 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091536 May 05 14:19:02.398209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1332/2348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:02.410557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:02.418451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-61bc0acc-394d-4fb4-9877-b154fd137c72 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.171592 May 05 14:19:02.419005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1017/2349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:02.667945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:02.668502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:02.674439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.674894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.675652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:02.676089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:02.799559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:02.807353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fd43f4b3-517f-4402-b25e-84c7e7c6c918 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143339 May 05 14:19:02.807914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1333/2350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:03.415075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:03.415616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:03.426046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.427725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.427725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.427725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.436606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:03.437222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:03.443532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.443981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.444745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.445182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.495948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:03.505898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f80bc53c-4cb6-4deb-80a2-b28bea87384c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.094840 May 05 14:19:03.506530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1018/2351] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:03.589645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:03.597939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76e18a75-efdc-4293-acc1-0f10e813fb88 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.165993 May 05 14:19:03.598534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1334/2352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:03.824393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:03.824986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:03.830971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.831423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.832216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:03.832653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:03.964871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:03.973228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-967a9951-3294-446d-8657-837a05c41ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.152742 May 05 14:19:03.973790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1019/2353] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:04.522261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:04.522794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:04.529631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.530104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:04.530862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.531300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:04.589483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:04.597754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44545e50-0084-4208-8946-63cdc1c536ce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079541 May 05 14:19:04.598349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1335/2354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:04.615725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:04.616341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:04.622664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.623117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:04.623883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.624323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:04.750677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:04.758729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e40774d-fdd2-4a0d-8d52-db8f619dbb93 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146894 May 05 14:19:04.759290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1020/2355] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:04.990121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:04.990809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:04.997341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.997787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:04.998575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:04.999006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:05.127813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:05.135599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f73210cd-7866-4a8d-8988-633791d5df4c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149361 May 05 14:19:05.136152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1336/2356] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:04 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:05.615571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:05.616189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:05.622240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:05.623295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:05.624057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:05.624494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:05.683833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:05.692346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-220c89cc-d706-48aa-a74b-b511c7390c8a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080703 May 05 14:19:05.692927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1021/2357] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:05.775744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:05.776287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:05.782664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:05.783115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:05.783962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:05.784403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:05.913783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:05.922453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b53a062a-2cc7-44c9-88f5-38bbb0b07255 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150434 May 05 14:19:05.923015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1337/2358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:06.152500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:06.153150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:06.159592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.163651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:06.163651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.163651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:06.287676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:06.295567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1fe2a1a1-689a-483f-b1bd-29ce49134cf4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146868 May 05 14:19:06.298612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1022/2359] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:06.709315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:06.709933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:06.715904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.716358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:06.717117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.717555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:06.777266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:06.785500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9760d2de-e581-4b79-bded-305fd7466d67 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080135 May 05 14:19:06.786081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1338/2360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:06.939779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:06.940430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:06.946764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.947307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:06.948078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:06.948552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:07.082418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:07.090360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c90660be-db8a-418f-9dfc-ecd1d6b829c0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154798 May 05 14:19:07.090928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1023/2361] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:07.316937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:07.317475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:07.323545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:07.323998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:07.324773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:07.325216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:07.456624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:07.464373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c3770a1-fb80-419a-b009-195dafad5a0e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151392 May 05 14:19:07.464969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1339/2362] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:07 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:07.801647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:07.802305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:07.808348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:07.808803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:07.809572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:07.810035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:07.873273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:07.882654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2efd8608-9093-4720-8a1b-9d3c63c235b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084918 May 05 14:19:07.883309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1024/2363] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:08.109024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:08.109635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:08.116009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.116454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.117207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.117641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.243818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:08.251584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3dec79d8-fa2f-4a3f-9270-c75f186b5101 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147372 May 05 14:19:08.252163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1340/2364] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:08.482044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:08.482715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:08.489247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.489701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.490491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.490927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.615054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:08.622815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fca656a2-1c64-453b-b323-4f703a983b47 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144923 May 05 14:19:08.623375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1025/2365] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:08 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:08.900744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:08.901361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:08.907620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.908070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.908829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:08.909264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:08.975501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:08.983666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc960f6f-fed6-4fe0-8542-5d93ecbd97f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086859 May 05 14:19:08.986442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1341/2366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:09.268744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:09.269279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:09.275531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:09.275983 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:09.276747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:09.277319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:09.401729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:09.409539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cb9d0ab8-f0ef-43c2-8ba3-caf8d8524766 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144778 May 05 14:19:09.410124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1026/2367] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:09.639937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:09.640582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:09.646929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:09.647379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:09.648137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:09.648576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:09.772278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:09.780649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a674f462-2ab7-42db-8557-22102ccc37da tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144686 May 05 14:19:09.781217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1342/2368] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:10.000004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:10.000554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:10.007463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.007918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.008690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.009135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.071674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:10.080140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bbdc6444-3118-4878-96a8-312dd535fb52 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084053 May 05 14:19:10.080710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1027/2369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:10.426305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:10.426917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:10.433000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.433447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.434227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.434663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.560554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:10.568215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bbeb619e-2081-4f97-a30a-513ffdbc2a90 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145726 May 05 14:19:10.568775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1343/2370] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:10.798260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:10.798837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:10.804679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.805125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.805880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:10.806348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:10.928225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:10.936475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ce25e837-94ea-4f06-8128-9b11ba0aa19e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142718 May 05 14:19:10.937026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1028/2371] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:10 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:11.097437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:11.098112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:11.104429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.105142 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.105906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.106372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.168790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:11.176544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7a811c5b-421f-42da-8d5d-63aa93963c48 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083018 May 05 14:19:11.177103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1344/2372] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:11.586381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:11.586976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:11.593368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.593816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.594740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.595177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.719799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:11.727584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-760e9e40-c7f3-4b3c-87c2-4823bd5fcee6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145260 May 05 14:19:11.728142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1029/2373] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:11 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:11.925210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:11.925802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:11.931750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.932209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.933062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.933417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.947105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. May 05 14:19:11.947697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:19:11.948524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-99c90b34-b4da-48bb-af55-2201c0536434 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 404 len: 111 microversion: 2.20 time: 0.027622 May 05 14:19:11.949059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1345/2374] 10.222.0.26 () {60 vars in 1279 bytes} [Thu May 5 14:19:11 2022] DELETE /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:19:11.952916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:11.953531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:11.956402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:11.957013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: 93818186-77bc-406b-8664-b67f320534c5] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:11.959422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.959872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.960637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.961073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.962722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.963174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.963936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:11.964369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:11.977987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. May 05 14:19:11.978594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance 93818186-77bc-406b-8664-b67f320534c5 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:19:11.979417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-918c1a1b-543c-48dc-9e94-977c37d34936 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5" status: 404 len: 111 microversion: 2.20 time: 0.026567 May 05 14:19:11.980214 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1346/2375] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:19:11 2022] GET /compute/v2.1/servers/93818186-77bc-406b-8664-b67f320534c5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 05 14:19:12.085492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:12.093815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe7729cc-7a8a-4dab-9af2-1609ec018e7e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144878 May 05 14:19:12.094401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1030/2376] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:11 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:12.192832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:12.193489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:12.199811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:12.200258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:12.201516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:12.201954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:12.264835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:12.272681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4e62418e-8048-4da1-bf97-75e7d6b2cc55 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083682 May 05 14:19:12.273243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1347/2377] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:12.744539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:12.745156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:12.752038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:12.752494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:12.753262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:12.753704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:12.878470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:12.886247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ae6e0dd-039b-44c9-a21e-d5e07b13e1b5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145513 May 05 14:19:12.886801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1031/2378] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:13.111483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:13.112096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:13.117985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.118471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:13.119222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.119658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:13.244115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:13.252354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-898512c3-e082-4e24-a9fd-050babb5d677 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145233 May 05 14:19:13.252910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1348/2379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:13.289854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:13.290509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:13.296916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.297359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:13.298145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.298580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:13.361085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:13.368814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-96d8d927-f903-4328-9b5a-53ccce9a230f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082846 May 05 14:19:13.369376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1032/2380] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:13.903650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:13.904862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:13.910964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.911418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:13.912181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:13.912623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:14.037518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:14.045345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9d915351-71c5-4942-93e3-7401e3177d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145621 May 05 14:19:14.045915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1349/2381] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:14.270009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:14.270583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:14.276904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:14.277357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:14.278154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:14.278597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:14.385565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:14.386244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:14.392974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:14.393432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:14.394234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:14.394680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:14.405236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:14.414707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9a8eaf53-2f8e-4763-b16a-d6a15aea50cc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148617 May 05 14:19:14.415615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1033/2382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:14 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:14.457995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:14.465803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-72442e21-fc91-4481-907b-dec368d3f5bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084085 May 05 14:19:14.466470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1350/2383] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:15.062769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:15.063426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:15.069496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.069947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.070742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.071177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.196279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:15.204737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9219a62a-6c75-4bf3-8c6c-2ab35ec2b647 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146479 May 05 14:19:15.205299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1034/2384] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:15.432965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:15.433594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:15.440088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.440539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.441305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.441741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.484483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:15.485537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:15.493207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.493660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.494521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:15.494957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:15.564402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:15.572173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-60693c2f-2345-41ee-9d52-715b24db156f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093495 May 05 14:19:15.572955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1035/2385] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:15.596265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:15.604002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3ebe39c1-42e9-4b0e-924e-5c784cd3ac7f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.175051 May 05 14:19:15.604555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1351/2386] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:15 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:16.221645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:16.222301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:16.228215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.228670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.229441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.230166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.356009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:16.364414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-93830cc1-579b-4b3a-ae49-9209c500367f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146815 May 05 14:19:16.364977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1036/2387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:16.589681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:16.590347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:16.597195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.597639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.598428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.598864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.620522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:16.621058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:16.627271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.627732 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.628491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:16.628927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:16.659863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:16.667818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c1e8bfcc-1cf8-422d-ad63-43ffed6b2285 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082000 May 05 14:19:16.668390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1352/2388] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:16.758644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:16.770721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e9f95dae-05cd-4551-9edd-0f01e35e9fe2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154007 May 05 14:19:16.771296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1037/2389] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:16 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:17.380665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:17.381194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:17.387114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.387559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.388980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.389418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.513801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:17.521634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e71398b8-6b2e-4a74-94d4-5b16c2e5ffde tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144922 May 05 14:19:17.522247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1353/2390] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:17.684785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:17.685959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:17.692461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.692911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.693751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.694211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.753452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:17.761353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-515e926c-8122-439a-a06a-b73412c0363e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080483 May 05 14:19:17.761905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1038/2391] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:17.790638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:17.791259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:17.798099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.798557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.799324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:17.799767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:17.927137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:17.934972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76f54853-4e20-43e0-b895-98bbe0ac15fc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148238 May 05 14:19:17.935479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1354/2392] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:18.538679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:18.539222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:18.545133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.545589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:18.546385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.546830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:18.676206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:18.684114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cf5782c6-f11f-4f30-9d65-bb8ec2a39bbe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149393 May 05 14:19:18.684683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1039/2393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:18.778175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:18.778820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:18.784777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.785229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:18.785991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.786455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:18.846215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:18.853973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4c23825c-40e4-4e4e-85dd-d41470947c30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079839 May 05 14:19:18.854561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1355/2394] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:18.952496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:18.953105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:18.959496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.959942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:18.960704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:18.961138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:19.086991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:19.094856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-07691dd5-3fd7-4c8a-9463-9ccc0ca9e886 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146746 May 05 14:19:19.095363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1040/2395] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:18 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:19.702310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:19.702924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:19.708865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:19.709318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:19.710102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:19.710542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:19.836428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:19.844858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0784b845-53b3-4aeb-b68c-8771fc81252c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146962 May 05 14:19:19.845430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1356/2396] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:19 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:19.871087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:19.871708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:19.877552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:19.878028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:19.878807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:19.879249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:19.937586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:19.945451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-33eb0a10-815c-43bf-897f-09f0dd8a441b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078313 May 05 14:19:19.946025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1041/2397] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:20.112547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:20.113159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:20.119121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.119573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.120328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.120764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.246211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:20.253972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-10d3e92a-75a7-4cc4-9720-18f2ebed2791 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145331 May 05 14:19:20.254558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1357/2398] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:20.861826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:20.862475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:20.868414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.868866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.869627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.870092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.962621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:20.963363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:20.970150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.970598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.971413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:20.971857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:20.996062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:21.004626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2cdf162f-2a8e-4207-99cc-4a1f2a63a1e5 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146613 May 05 14:19:21.005202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1042/2399] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:21.034461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:21.042310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ebfb33ff-031e-4991-84b0-406469145076 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083452 May 05 14:19:21.042876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1358/2400] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:21.271090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:21.275421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:21.277604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:21.278089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:21.278860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:21.279299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:21.405400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:21.413428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d721a208-1353-492f-acf9-ab8d74de1eb4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146257 May 05 14:19:21.413997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1043/2401] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:21 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:22.022247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:22.022866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:22.029824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.030303 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.031067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.031505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.058899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:22.059555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:22.066031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.066497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.067273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.067716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.140727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:22.148477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-566f4124-4c1c-4940-bf64-17e1c2c27d35 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093367 May 05 14:19:22.149041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1044/2402] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:22.178432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:22.186323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8a4cd83c-2666-41f5-9667-aa3e8350304f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.167989 May 05 14:19:22.186886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1359/2403] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:22.430508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:22.431132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:22.437792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.438284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.440338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:22.440338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:22.563809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:22.571554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3163d932-132e-4016-94e7-9108f548bc7b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144941 May 05 14:19:22.572120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1045/2404] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:22 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:23.165624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:23.166265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:23.173076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.173525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.174322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.174764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.202443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:23.204733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:23.211440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.211900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.212885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.213340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.234451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:23.242791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-791a86fc-c1d9-4de8-8057-6b147798bb56 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081054 May 05 14:19:23.243366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1360/2405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:23.339701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:23.347936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0c09af3e-949b-4840-b24c-da2d7b559755 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149369 May 05 14:19:23.348494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1046/2406] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:23.589466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:23.590144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:23.596791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.597245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.598004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:23.598469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:23.721380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:23.729128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-09cdd238-3e8b-4c10-8c95-a69c0d87accb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143496 May 05 14:19:23.729686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1361/2407] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:23 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:24.259758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:24.260311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:24.267237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.267683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.268445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.268877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.327773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:24.335538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e9e4553-f120-46ba-a2e4-e6ec304e1cab tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079694 May 05 14:19:24.336091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1047/2408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:24.365609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:24.366259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:24.372572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.373025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.373821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.374289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.504971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:24.513297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7f301185-8159-4d69-8b9b-b86634340d2a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150975 May 05 14:19:24.513803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1362/2409] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:24 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:24.746351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:24.746970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:24.753397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.753853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.754658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:24.755108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:24.877443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:24.885200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d9c0697c-e750-487e-8d05-b98db8c48e53 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142752 May 05 14:19:24.885762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1048/2410] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:24 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:25.352668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:25.353218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:25.359487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.359940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:25.360705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.361169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:25.420399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:25.428150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05bef225-3a1f-4d5b-a42d-891b49865fcc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079422 May 05 14:19:25.428721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1363/2411] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:25.530849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:25.531468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:25.537858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.538343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:25.539112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.539549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:25.665712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:25.674229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-acf48d10-4d62-45f6-91f0-743b7cec1a3b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147753 May 05 14:19:25.674790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1049/2412] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:25.904121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:25.904660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:25.910823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.911275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:25.912039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:25.912483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:26.038086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:26.046366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69c4e600-fa09-4ee1-bcf6-2266ff5d78a2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147350 May 05 14:19:26.046933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1364/2413] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:26.444863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:26.445509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:26.452192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:26.452649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:26.453417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:26.453858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:26.513691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:26.521503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2d21d05-2146-4bb4-9070-4a3d5101f8f0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080698 May 05 14:19:26.522084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1050/2414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:26.690614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:26.691238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:26.697689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:26.698124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:26.698907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:26.699342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:26.826744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:26.834503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1d01741c-1b3c-4e74-8bf8-5e4ffe96995c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147791 May 05 14:19:26.835075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1365/2415] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:27.063425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:27.063971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:27.070317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.070772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.071544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.071979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.196300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:27.204674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f7bcda19-a67f-4912-b1cc-2ad471346333 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145302 May 05 14:19:27.205240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1051/2416] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:27.538421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:27.539031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:27.545477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.545922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.546696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.547127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.609566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:27.617369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0108302e-d455-49bc-b8ab-c9b00b7d8e78 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082812 May 05 14:19:27.617931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1366/2417] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:27.851760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:27.852382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:27.859229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.859686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.860458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:27.860908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:27.982099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:27.990000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c77d66dd-bf4e-4b46-b8b6-8c048fcf5c53 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142049 May 05 14:19:27.990594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1052/2418] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:28.221863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:28.222528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:28.228533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:28.228982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:28.229733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:28.230453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:28.354378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:28.362827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-15949ec3-1f97-42d5-bd21-439500aa79c6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144855 May 05 14:19:28.363397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1367/2419] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:28.634107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:28.634648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:28.641487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:28.641963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:28.642751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:28.643186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:28.704975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:28.712696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e998319b-1ba2-4be4-b6e5-1c37a8f887f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082500 May 05 14:19:28.713249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1053/2420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:29.007333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:29.007877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:29.013787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.014279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.015046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.015495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.140126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:29.147986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-12a65f53-3bfb-492a-8092-5ae68a85f6e9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144598 May 05 14:19:29.148550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1368/2421] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:29.380297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:29.380921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:29.386895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.387353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.388141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.388582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.513581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:29.521329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e35452b-4382-472c-8db5-060b3b6d1d41 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144980 May 05 14:19:29.521883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1054/2422] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:29 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:29.729468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:29.730389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:29.736641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.737086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.737836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:29.738297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:29.800316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:29.808258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2e787648-2ff9-4ef7-ab68-cb03a6ccfca8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082674 May 05 14:19:29.808834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1369/2423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:30.164649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:30.165260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:30.172228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.172678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.173444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.173882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.298754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:30.306525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4b387224-8fb5-41af-a336-077a3845d8ab tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145787 May 05 14:19:30.307091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1055/2424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:30.541732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:30.542296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:30.548615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.549068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.549843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.550842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.680622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:30.688992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-96d30bfd-2af1-41fe-8998-28069876739e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151234 May 05 14:19:30.689555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1370/2425] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:30 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:30.824752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:30.826190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:30.832416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.832859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.833622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:30.834076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:30.899835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:30.907722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e866400d-37e7-460e-aaeb-e78df5bb8954 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086920 May 05 14:19:30.908280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1056/2426] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:31.323515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:31.324136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:31.330490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.330943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.331709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.332146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.461253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:31.469855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2be41d85-b164-4cdd-85c2-39c30c31e842 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150229 May 05 14:19:31.470447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1371/2427] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:31 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:31.706756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:31.707324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:31.713666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.714158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.714924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.715362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.845605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:31.853476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e629901-f468-460c-bd3b-ca21461cb686 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150655 May 05 14:19:31.854081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1057/2428] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:31 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:31.925420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:31.926045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:31.931918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.932358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.933110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:31.933540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:31.995379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:32.003121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-54aba2cc-f262-4b35-ba92-5dd55642780f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081513 May 05 14:19:32.003677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1372/2429] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:32.487474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:32.488084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:32.494057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:32.494509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:32.495263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:32.495698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:32.619791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:32.628135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f54e27dd-9e15-48ae-9281-af0945e1648e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144535 May 05 14:19:32.628700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1058/2430] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:32.871164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:32.871789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:32.878263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:32.878719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:32.879485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:32.879934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:33.005851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:33.013722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-abd745e6-8d40-4aef-a4ca-9db568ba7383 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146461 May 05 14:19:33.014323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1373/2431] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:33.019099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:33.019761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:33.026318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:33.026776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:33.027540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:33.027986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:33.089964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:33.098495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d1981344-e5b0-42f1-b6b0-03faa95ed358 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083294 May 05 14:19:33.099058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1059/2432] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:33.644907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:33.645530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:33.651538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:33.651989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:33.652750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:33.653220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:33.775209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:33.783315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d13e5d34-04bb-441b-bfa7-fdcb28541a18 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142246 May 05 14:19:33.783877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1374/2433] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:34.030816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:34.031365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:34.037688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.038177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.038940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.039380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.116106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:34.116735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:34.123785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.124243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.125014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.125461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.173585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:34.181439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8b0addd4-8682-467e-8697-db220bb08b78 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154536 May 05 14:19:34.182007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1060/2434] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:34.192503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:34.200399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-efac6bd5-ba3e-4292-8c19-87fd9e96d31c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088257 May 05 14:19:34.200960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1375/2435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:34.799995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:34.800613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:34.806591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.807042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.807800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:34.808236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:34.930226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:34.937919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2f1717d1-9f1e-46b4-9d02-19c22dd520a8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.141808 May 05 14:19:34.938501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1061/2436] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:35.199193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:35.199853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:35.206479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.206938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:35.207708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.208152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:35.216999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:35.217607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:35.223954 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.224401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:35.225159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.225592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:35.303260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:35.311300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6ee4708b-dae3-46da-82e6-7847629cdb61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.098632 May 05 14:19:35.311872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1062/2437] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:35.359342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:35.367263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-416ff2c3-d867-4259-bd5f-3f1f03c72d75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.172003 May 05 14:19:35.367825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1376/2438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:35.953874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:35.954518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:35.960407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.960861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:35.961622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:35.962082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:36.085216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:36.093481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b564e9d8-f7c1-4ada-9987-97aa993f9041 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143543 May 05 14:19:36.094061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1063/2439] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:36.328542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:36.329160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:36.335486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:36.335937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:36.336695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:36.337131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:36.384267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:36.384885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:36.391778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:36.392238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:36.393008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:36.393461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:36.397786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:36.407372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1032983f-bff0-4375-b07c-876f1cf9fdf0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083147 May 05 14:19:36.408252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1377/2440] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:36.522661 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:36.531095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-acd246ef-b1bd-455d-ad65-c0a46965deef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150693 May 05 14:19:36.531657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1064/2441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:36 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:37.111105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:37.111718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:37.117599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.118367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.118828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.119263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.242419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:37.250154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cbaab221-0949-4408-9fb1-272fcc0256a1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142873 May 05 14:19:37.250710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1378/2442] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:37.424305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:37.425035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:37.431623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.432066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.432823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.433285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.492881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:37.501184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0009f020-4e5f-4a25-8ee9-dfd37924c40c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080876 May 05 14:19:37.501734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1065/2443] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:37.548132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:37.548752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:37.555166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.555621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.556390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:37.556830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:37.938612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:37.946388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2da3056d-f7e9-4031-8080-baf41ef38141 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.402153 May 05 14:19:37.946964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1379/2444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:37 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:38.266992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:38.267535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:38.273483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.273936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:38.274748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.275169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:38.397173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:38.405443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fb43a501-13d7-4973-beab-f20cde5c738d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142360 May 05 14:19:38.406003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1066/2445] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:38 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:38.519244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:38.519781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:38.525765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.526260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:38.527034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.527477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:38.589926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:38.600138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8dc81db8-4b4b-4c36-ad6f-15500fe296e8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084904 May 05 14:19:38.600719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1380/2446] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:38.963622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:38.964270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:38.970826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.971267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:38.972019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:38.972455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:39.095462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:39.103532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4ab44a81-8bc2-4522-9001-ca8341d8eed2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143795 May 05 14:19:39.104086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1067/2447] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:39.422361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:39.422980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:39.428950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:39.429408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:39.430218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:39.430656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:39.618682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:39.619870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:39.624433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:39.625774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:39.626271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:39.627054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:39.627606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:39.632771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0ad8db56-199f-4f00-b0b2-e6382cfa7c94 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.214368 May 05 14:19:39.633338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1381/2448] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:39.693155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:39.702075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3aeadbde-2766-4e64-a2be-5107502b21d9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087179 May 05 14:19:39.702650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1068/2449] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:40.120678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:40.121295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:40.127293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.127744 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.128503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.128942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.252446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:40.260320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f83c59f5-e2f2-410a-a0be-06a84b5e565c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143478 May 05 14:19:40.260889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1382/2450] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:40.650534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:40.651080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:40.657448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.657896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.658710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.659132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.718993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:40.719717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:40.726280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.726765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.727547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:40.727990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:40.792262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:40.800442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b6946aed-5bef-44f8-b51a-002144e191ff tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085335 May 05 14:19:40.801010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1383/2451] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:40.813797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:40.821479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-856e782a-9c8e-4746-bdfd-d4ef82751c3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.174917 May 05 14:19:40.822042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1069/2452] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:41.278406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:41.279543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:41.285404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.285858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.286653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.287091 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.424361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:41.432443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6f500e3b-9d8e-400b-ac0f-bfc630e0c3f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.157895 May 05 14:19:41.433006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1384/2453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:41.816989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:41.817527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:41.824012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.824461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.825223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.826333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.838242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:41.838857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:41.845046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.845489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.846291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:41.846715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:41.891516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:41.899516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2d63d9e0-4a40-40eb-aa82-ae865504d2d3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086435 May 05 14:19:41.900091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1070/2454] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:41.982037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:41.990330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-040fb5fb-3720-4093-b4d2-207be4285d9e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.155781 May 05 14:19:41.991096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1385/2455] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:42.449512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:42.450061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:42.456516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:42.456963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:42.457717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:42.458176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:42.580697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:42.588495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-41ba898a-3ea5-4cbe-8be2-a961b1845be6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142946 May 05 14:19:42.589056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1071/2456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:42.915628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:42.916237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:42.923079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:42.923524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:42.924288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:42.924722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:42.987487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:42.995247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-53ad026f-7dfe-4c16-a157-3d8381bbe72b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083442 May 05 14:19:42.995809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1386/2457] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:43.007654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:43.008272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:43.015264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:43.015724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:43.016502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:43.016952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:43.142080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:43.149893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0a16cdf-6c86-4aec-a230-71f8dbc6544e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146133 May 05 14:19:43.150484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1072/2458] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:43.605963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:43.606625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:43.613116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:43.613559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:43.614345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:43.614780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:43.737577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:43.745302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-868f12f4-8026-4817-8166-02e6aac6bf82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143484 May 05 14:19:43.745887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1387/2459] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:43 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:44.012201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:44.012753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:44.019714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.020170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.020938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.021387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.084379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:44.092171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b20e7ae8-6d70-4fe1-8f17-ecf653129ad5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083982 May 05 14:19:44.092736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1073/2460] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:44.167610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:44.168234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:44.174646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.175106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.175870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.176316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.300117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:44.307889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-915d23c9-1b39-44cb-94bb-9df083535a05 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144299 May 05 14:19:44.308455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1388/2461] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:44.762366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:44.762991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:44.769044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.769501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.770294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:44.770739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:44.893075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:44.900854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6a20f8c-9662-4652-9bd3-6a895f6a6a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142359 May 05 14:19:44.901411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1074/2462] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:44 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:45.109478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:45.110113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:45.116010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.116453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:45.117207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.117637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:45.179380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:45.187227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2bdeaa9-483e-48fc-bdfe-6d213c192ee7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082516 May 05 14:19:45.187781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1389/2463] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:45.324423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:45.325045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:45.331913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.332365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:45.333131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.333570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:45.457339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:45.465173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f6a4a39c-6624-4006-8862-f6c1e932b48f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144538 May 05 14:19:45.465738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1075/2464] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:45 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:45.918664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:45.919936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:45.925928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.931137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:45.931137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:45.931137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:46.054783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:46.063105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-39cc64c2-3b60-44a1-8fe6-bddb6377c0e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148322 May 05 14:19:46.063675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1390/2465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:45 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:46.203619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:46.204194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:46.210170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:46.211454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:46.211454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:46.211927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:46.274606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:46.282501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5dcd6500-63a0-4a49-abee-bff580950924 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082898 May 05 14:19:46.283060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1076/2466] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:46.484204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:46.484746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:46.491266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:46.491726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:46.492485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:46.492922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:46.617431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:46.625174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c8228386-5431-480d-aab6-469d4d51deff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145849 May 05 14:19:46.625743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1391/2467] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:47.080112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:47.080729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:47.087403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.087856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.088632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.089071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.225756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:47.234337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8013cac9-f483-41b4-b016-3d4c13e009f3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158209 May 05 14:19:47.234893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1077/2468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:47.299634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:47.300247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:47.305980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.306468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.307222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.307670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.370920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:47.378675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ac6ea7b-c2e0-4b73-9b8d-6d67edf28fb0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083454 May 05 14:19:47.379242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1392/2469] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:47.642767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:47.643333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:47.649283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.649736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.650533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:47.650972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:47.776294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:47.784768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cbe2ea92-3110-4c1f-a149-a841f4c882ae tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146538 May 05 14:19:47.785332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1078/2470] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:48.251324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:48.251947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:48.258280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.258725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.259475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.259909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.383355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:48.391672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-21989a92-0761-47c7-8140-5359a86e7fb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144192 May 05 14:19:48.392239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1393/2471] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:48.395669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:48.396292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:48.402645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.403104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.403876 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.404959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.466546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:48.474933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-379eea4f-e6b9-4cef-83b8-18e21af1df90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083078 May 05 14:19:48.475490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1079/2472] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:48.801218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:48.801840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:48.807828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.808281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.809050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:48.809489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:48.935403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:48.943195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7a1b016b-1035-4105-b01c-2cdbcf099c5b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145833 May 05 14:19:48.943764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1394/2473] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:49.409225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:49.409847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:49.416169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.416612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:49.417365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.417800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:49.494552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:49.495171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:49.501601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.502085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:49.502855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.503294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:49.556477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:49.564367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3522fb9c-252a-4731-beb0-e02cde4ed022 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.159491 May 05 14:19:49.564941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1080/2474] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:49.581389 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:49.590611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3ed1eb5a-8496-4513-948a-f65a94b07ed5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.102191 May 05 14:19:49.591177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1395/2475] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:49.960575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:49.961194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:49.967787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.968248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:49.969011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:49.969448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:50.093248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:50.101115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe06816d-f17e-4df8-aeca-3e60049551ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144373 May 05 14:19:50.101673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1081/2476] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:50.580677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:50.581302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:50.587771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:50.588226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:50.588996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:50.589439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:50.608521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:50.609138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:50.615626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:50.616076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:50.616944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:50.617494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:50.680257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:50.688633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e2823352-9c08-4d35-bb7e-011e6c452362 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084712 May 05 14:19:50.689198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1082/2477] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:50.742249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:50.750646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0352649a-b15e-41e4-a651-0435124f9688 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.173881 May 05 14:19:50.751211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1396/2478] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:50 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:51.117521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:51.118169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:51.124104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.124554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.125312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.125748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.247949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:51.255679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6b4a4876-6ed4-4836-9d54-89680a5d2419 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.142019 May 05 14:19:51.256244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1083/2479] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:51.705498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:51.706136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:51.712427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.712874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.713630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.714088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.768144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:51.768764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:51.774734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:51.775178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.775635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.776406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:51.776846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:51.782594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b5c28c4a-985d-465e-8344-d2f82d85df75 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081524 May 05 14:19:51.783159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1397/2480] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:51.904796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:51.912540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-537b9af6-1b0e-4199-a62d-db8458fb5e26 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148863 May 05 14:19:51.913108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1084/2481] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:52.272939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:52.273549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:52.279957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.280407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:52.281159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.281593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:52.406821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:52.414599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b514ec8b-f124-469c-9933-4db49de90289 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145543 May 05 14:19:52.415167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1398/2482] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:52 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:52.798475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:52.799008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:52.805497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.805960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:52.806751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.807194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:52.866883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:52.874613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-656b6236-6f7c-4340-aa5b-1669e36db171 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080089 May 05 14:19:52.875185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1085/2483] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:52.929994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:52.942666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:52.942666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.942666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:52.942666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:52.943148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:53.067710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:53.075607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc7d0984-f7f2-4747-9a42-566966501e22 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149502 May 05 14:19:53.076177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1399/2484] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:53.431688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:53.432295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:53.438301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:53.438744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:53.439508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:53.439939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:53.567116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:53.574949 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69dc70f2-a448-484f-a3d5-1fcf4a9359a9 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147094 May 05 14:19:53.575519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1086/2485] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:53.891388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:53.892003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:53.897961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:53.898444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:53.899203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:53.899642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:53.959185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:53.966792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bb80e661-75f6-4343-a483-0c3a5a4d0fbb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079329 May 05 14:19:53.967941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1400/2486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:54.093516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:54.094162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:54.101030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.101476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:54.102267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.102690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:54.232358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:54.240119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dd6eb311-e325-45b0-a533-4f65dd39f6a6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150927 May 05 14:19:54.240678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1087/2487] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:54.591452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:54.592072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:54.598073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.598530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:54.599304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.599747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:54.722961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:54.731053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b1df677e-857c-4e70-ad7f-21767a645800 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143431 May 05 14:19:54.731628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1401/2488] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:54.984866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:54.985397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:54.991322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.991775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:54.992558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:54.992991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:55.059445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:55.068196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7126cbb0-290c-41d5-bb74-953a3d3a3589 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088030 May 05 14:19:55.068759 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1088/2489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:55.256973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:55.257534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:55.264004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:55.264457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:55.265224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:55.265668 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:55.397796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:55.406204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e89c38ab-7b9a-46c1-99cc-1a092eef85ca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.153059 May 05 14:19:55.406776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1402/2490] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:55.747273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:55.747888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:55.754373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:55.754818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:55.755586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:55.756022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:55.882283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:55.890739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cb264064-add0-46e0-ac7b-990c6ce11f60 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147519 May 05 14:19:55.891293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1089/2491] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:56.084601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:56.085228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:56.091228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.091687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:56.092470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.092932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:56.156296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:56.163959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aebb60eb-4f57-4126-ae70-3fd6426aa93f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083234 May 05 14:19:56.164520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1403/2492] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:56.423758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:56.424327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:56.430375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.430830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:56.431592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.432034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:56.556640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:56.565168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bfa6caa3-1eaf-4434-8d14-ffb163924530 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145862 May 05 14:19:56.565729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1090/2493] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:56.907348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:56.907964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:56.914574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.915025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:56.915786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:56.916222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:57.043737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:57.052411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0bc14f22-bece-4684-b082-a148abc8c3ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149428 May 05 14:19:57.052976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1404/2494] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:57.180384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:57.180924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:57.187276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:57.187724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:57.188480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:57.188911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:57.251867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:57.259541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-40a8cd2b-e53a-4475-8939-94dd73165108 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083179 May 05 14:19:57.260121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1091/2495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:57.581975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:57.582623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:57.588565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:57.589016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:57.589774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:57.590251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:57.726298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:57.734945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-49b833ea-e43f-4c8f-917b-70adc25b2852 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.156843 May 05 14:19:57.735510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1405/2496] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:57 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:58.069267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:58.069804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:58.075706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.076205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.076968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.077401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.201362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:58.209165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-541627e1-2f67-4c86-b0c8-806849290eb1 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143856 May 05 14:19:58.209739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1092/2497] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:58.276871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:58.277490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:58.283883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.284345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.285111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.285555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.347340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:58.355320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-189ab4ca-e19f-4594-9bda-de7f26b310ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082215 May 05 14:19:58.355894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1406/2498] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:58.752437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:58.753009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:58.758993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.759443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.760241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:58.760677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:58.884911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:58.893328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f373e80e-085c-47f4-b1ce-df024f91d23b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144850 May 05 14:19:58.893893 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1093/2499] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:59.226298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:59.226907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:59.233760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.234234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:59.234988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.235423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:59.359958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:59.367779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-05b84b09-08f2-4b58-9b18-6fdb52d75157 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145378 May 05 14:19:59.368335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1407/2500] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:59 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:19:59.372518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:59.373260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:59.379606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.380052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:59.380811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.381243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:59.444736 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:19:59.452982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-de65af39-3f8c-4aee-8f1f-51ccafaab17e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084288 May 05 14:19:59.453545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1094/2501] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:19:59.910362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:19:59.910978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:19:59.916865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.917309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:19:59.918083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:19:59.918514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:00.043286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:00.050998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4909a6ac-0b1e-49ea-abef-860f7af54c5c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144590 May 05 14:20:00.051568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1408/2502] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:19:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:00.384603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:00.385224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:00.391583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:00.392067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:00.392834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:00.393277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:00.469874 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:00.470540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:00.476927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:00.477376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:00.478164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:00.478604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:00.530171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:00.538237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7943087d-df83-4fec-99d4-0d857d358fad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.157461 May 05 14:20:00.538900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1095/2503] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:00.549512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:00.557459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-13f6f93b-77af-4b03-9acc-67791dcd677d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091447 May 05 14:20:00.558035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1409/2504] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:01.068065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:01.068682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:01.074743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.075188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.075943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.076378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.204063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:01.211781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1d7f4f05-8167-4695-bec4-f716c3a53f40 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147575 May 05 14:20:01.212340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1096/2505] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:01.555767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:01.556432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:01.562881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.563339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.564097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.564534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.573486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:01.574132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:01.580404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.580982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.581753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:01.582225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:01.656342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:01.664381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b69544f2-bf55-4e12-a583-7d604e794744 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.094596 May 05 14:20:01.670489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1097/2506] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:01.718064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:01.725893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51484799-db84-4688-abec-28ce853c8f2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.173989 May 05 14:20:01.726502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1410/2507] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:02.228018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:02.228634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:02.234947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.235401 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.236163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.236603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.360259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:02.367964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f747cfa2-8ff5-4fa4-bd71-5408b6b10f80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143886 May 05 14:20:02.368566 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1098/2508] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:02.681703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:02.682284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:02.689143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.689588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.690370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.690808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.744616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:02.745224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:02.752457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.752671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.753434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:02.753869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:02.754830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:02.762732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b71e8c8-b3af-4d95-9d08-b864594db3ae tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084890 May 05 14:20:02.763304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1411/2509] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:02.879559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:02.887373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-eca7fff5-af94-4a3c-966e-9c845963610a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146600 May 05 14:20:02.887937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1099/2510] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:03.394373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:03.394915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:03.400886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.401339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:03.402135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.402580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:03.526575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:03.534902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9c65427b-b0fc-45d6-99d4-ff0b4ffed33a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144502 May 05 14:20:03.535457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1412/2511] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:03.779045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:03.779565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:03.785988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.786472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:03.787238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.787677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:03.847203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:03.854857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a89dc1d-0f8e-4552-b9db-c56911232c54 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079780 May 05 14:20:03.855699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1100/2512] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:03.904485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:03.905104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:03.911471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.911922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:03.912690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:03.913145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:04.039093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:04.047289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b8a60da-2788-4b38-99f6-d16bb0d5588d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146575 May 05 14:20:04.047858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1413/2513] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:04.552745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:04.553359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:04.559313 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:04.559762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:04.561032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:04.561469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:04.684773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:04.693146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aaab4753-9d26-402e-a648-b47fffa2e2d2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144294 May 05 14:20:04.693711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1101/2514] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:04 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:04.871017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:04.871638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:04.878251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:04.878731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:04.879487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:04.879923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:04.938157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:04.945819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c084b2b-4fb9-407a-b784-faa93b87980b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078602 May 05 14:20:04.946412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1414/2515] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:05.063924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:05.064600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:05.070987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.071439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:05.072205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.072645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:05.202338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:05.210169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5834b637-2189-43eb-8323-22c2b502a5d3 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150018 May 05 14:20:05.210738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1102/2516] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:05 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:05.710209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:05.710831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:05.717483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.717932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:05.718715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.719154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:05.846277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:05.854005 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b16f5720-ca8b-4287-b233-d6a64bc0c99a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147732 May 05 14:20:05.854612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1415/2517] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:05 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:05.962530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:05.963146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:05.969060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.969506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:05.970282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:05.970718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:06.032860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:06.040555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-02394faf-6124-434e-b3a4-5d22cfec4617 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081871 May 05 14:20:06.041105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1103/2518] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:06.227590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:06.228212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:06.235439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:06.235891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:06.236653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:06.237096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:06.361765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:06.369604 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7df4c0e4-a8db-4d7d-9c9a-8e5a62e1c41c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145853 May 05 14:20:06.370183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1416/2519] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:06.871317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:06.871938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:06.878333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:06.878788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:06.879558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:06.879998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:07.002272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:07.010031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5f472061-54e2-4e85-9275-31ec5dc14926 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142537 May 05 14:20:07.010593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1104/2520] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:07.056603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:07.057220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:07.063766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:07.064213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:07.064969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:07.065409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:07.129434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:07.137395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4df03ea2-296b-40a3-8fbc-6d6dc8e9800c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084707 May 05 14:20:07.142055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1417/2521] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:07.386443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:07.386995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:07.393371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:07.393791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:07.394596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:07.395066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:07.520422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:07.528280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5a8bdab1-905d-4a13-8d4c-125d2f57d0db tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145766 May 05 14:20:07.528842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1105/2522] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:08.027069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:08.027621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:08.034557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.035003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.035756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.036190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.154132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:08.154744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:08.160986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.161366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:08.161507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.162213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.162654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.169547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-606c3b7e-13dc-40aa-8756-8af064b7cd86 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146350 May 05 14:20:08.170238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1418/2523] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:08 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:08.225477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:08.233447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-771e131a-643e-4cd8-a264-6f28986be862 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083122 May 05 14:20:08.234604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1106/2524] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:08.545522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:08.546166 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:08.552155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.552603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.553365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:08.553805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:08.682436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:08.693608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8194f89d-76e5-496d-be0d-bf80edd37f8e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151910 May 05 14:20:08.694218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1419/2525] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:09.187280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:09.187898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:09.194315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.194766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.195529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.195970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.251305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:09.251855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:09.258244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.258698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.259457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.259897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.329846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:09.339318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ad4254e5-3682-4a38-b3dc-7612ad5a0ea6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.092403 May 05 14:20:09.339903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1420/2526] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:09.355562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:09.363791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-66b4850e-d42a-4adf-9844-633c6b55d3a7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.180989 May 05 14:20:09.364347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1107/2527] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:09.724592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:09.725210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:09.731504 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.731958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.732723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:09.733171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:09.857074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:09.864838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e0dd1239-e65c-4912-a4db-971eba96b7fe tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144098 May 05 14:20:09.865409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1421/2528] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:10.356946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:10.357573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:10.365012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.365463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:10.366270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.366710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:10.380976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:10.381701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:10.388476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.392014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:10.392014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.392014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:10.429716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:10.440992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ebb2838e-94cb-4b2d-a16f-948a23babc7f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088690 May 05 14:20:10.441741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1108/2529] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:10.524718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:10.533140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c614c37c-9164-4747-8491-840b8b158d82 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.156301 May 05 14:20:10.533704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1422/2530] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:10 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:10.882165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:10.882787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:10.888771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.889219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:10.889980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:10.890439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:11.014598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:11.022396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b4c215f4-a232-4219-84b2-4fe22f3a615d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144120 May 05 14:20:11.022964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1109/2531] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:10 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:11.457897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:11.458477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:11.464880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:11.465340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:11.466141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:11.466869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:11.528544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:11.536340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69b66528-1b26-4eb8-b841-e5a38692eb41 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082375 May 05 14:20:11.536905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1423/2532] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:11.550928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:11.551541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:11.557940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:11.558419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:11.559177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:11.559612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:11.695699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:11.704015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-af3e4d6f-61f2-46b5-b2db-2fc8e8541612 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.157637 May 05 14:20:11.704597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1110/2533] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:11 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:12.039441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:12.040059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:12.046068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.046522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.047280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.047719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.171959 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:12.179829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e1648a1-e616-4d46-9576-3d387e42b527 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144186 May 05 14:20:12.180396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1424/2534] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:12 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:12.553230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:12.553847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:12.560266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.560717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.561483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.561922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.621002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:12.628751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4bcb07fe-4ae8-4053-aaf4-d593639ded02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079475 May 05 14:20:12.629318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1111/2535] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:12.720978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:12.721599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:12.728566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.729022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.729785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:12.730517 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:12.857098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:12.865430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8242bf55-437b-4d8a-bde1-2e6ff618d390 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149168 May 05 14:20:12.865991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1425/2536] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:12 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:13.197322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:13.197945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:13.204218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.204679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:13.205458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.205913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:13.331156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:13.339026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-54da9d5a-2554-441c-a214-8715a93e4b98 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145595 May 05 14:20:13.339600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1112/2537] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:13 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:13.646345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:13.646971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:13.652910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.653367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:13.654158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.654608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:13.721194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:13.729219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e130490-3872-4220-9b9c-8f036dd23cf9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086836 May 05 14:20:13.729782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1426/2538] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:13.881677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:13.882323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:13.888788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.889236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:13.889989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:13.890445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:14.017607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:14.025443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b9af5c79-11dc-4ba7-b53f-a693b843d9f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147618 May 05 14:20:14.026002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1113/2539] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:14.356620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:14.357227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:14.363820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:14.364266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:14.365046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:14.365480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:14.487798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:14.495513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8e307968-9361-4d74-b96c-596523b7cdfc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143024 May 05 14:20:14.496071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1427/2540] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:14 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:14.746137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:14.746708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:14.753092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:14.753547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:14.754352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:14.754795 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:14.817595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:14.825338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-82e1e81b-44c0-4285-870e-f1aa10ed15c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083215 May 05 14:20:14.825900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1114/2541] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:15.042584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:15.043127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:15.050068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.050521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.051271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.051705 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.175827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:15.183491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1ae36cc9-b3c2-42a8-b772-5eff4f3ce635 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144785 May 05 14:20:15.184056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1428/2542] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:15 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:15.511545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:15.512158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:15.518534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.518987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.519755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.520194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.644475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:15.652160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cd7d096e-a9f2-4371-b805-44695db4e3ad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144437 May 05 14:20:15.652731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1115/2543] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:15 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:15.842386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:15.843000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:15.850475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.851202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.852453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:15.853204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:15.916619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:15.924372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a263fa8d-ae46-4b82-a3d7-5f57af8b7e23 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085962 May 05 14:20:15.924928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1429/2544] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:16.200302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:16.200919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:16.207537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.207989 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:16.208780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.209217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:16.334907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:16.342687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-34a4acf7-9810-4949-83ed-be6259516d79 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146183 May 05 14:20:16.343265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1116/2545] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:16 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:16.669673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:16.670328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:16.677197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.677651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:16.678456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.678902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:16.807367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:16.815802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e22c5b7-cc5c-4f24-ba11-1b9561c63847 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150105 May 05 14:20:16.816364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1430/2546] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:16 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:16.941552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:16.942095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:16.948442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.948892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:16.949656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:16.950120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:17.011780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:17.019557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-45065793-c89e-49c2-8a4a-6f608a8326c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082569 May 05 14:20:17.020132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1117/2547] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:17.361571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:17.362230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:17.368158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:17.368615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:17.369376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:17.369821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:17.499814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:17.507655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1a918598-6082-46c6-ad0d-852b15d1e392 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150716 May 05 14:20:17.508234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1431/2548] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:17.832702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:17.833319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:17.839511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:17.839964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:17.840761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:17.841210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:17.969538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:17.977654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1b344c8c-dd99-496e-951e-2c8a13728c2e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148790 May 05 14:20:17.978262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1118/2549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:17 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:18.037752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:18.038393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:18.044948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:18.045397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:18.046200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:18.046635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:18.109109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:18.117546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec610689-5373-4a1a-b240-ac66af27786f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083825 May 05 14:20:18.118127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1432/2550] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:18.524647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:18.525173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:18.531674 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:18.532125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:18.532881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:18.533315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:18.666304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:18.674819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5cb33e95-70c4-4b72-8ab7-9156b0ee4842 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154040 May 05 14:20:18.675396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1119/2551] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:18 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:18.995459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:18.996066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:19.001905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.002387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.003139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.003580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.126882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:19.134225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:19.134683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a97acd9-5b05-497a-9d2c-4318064983f7 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143004 May 05 14:20:19.134877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:19.135253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1433/2552] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:18 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:19.141673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.142153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.142929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.143374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.205445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:19.213249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e90c8119-f400-42a0-acba-7180b9bd5378 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082843 May 05 14:20:19.213818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1120/2553] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:19.692249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:19.693480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:19.698947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.699395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.700150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:19.700587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:19.825294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:19.833478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5cf81e8b-8560-404e-83b4-92321367f5f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145082 May 05 14:20:19.834054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1434/2554] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:19 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:20.152052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:20.152671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:20.158585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.159039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.159799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.160240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.230938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:20.231564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:20.237972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.238460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.239232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.239676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.291924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:20.299787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-29f17a17-e02f-44b2-89c4-9a27a0e89cad tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.151707 May 05 14:20:20.300354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1121/2555] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:20 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:20.310279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:20.318789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a50d016b-ce35-4392-aefa-65ab1dc5a35c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.092072 May 05 14:20:20.319365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1435/2556] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:20.850839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:20.851453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:20.857631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.858100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.858854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:20.859936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:20.981072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:20.989385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1164def0-de28-4fc4-9c2f-217e17ff9f4f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142396 May 05 14:20:20.989946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1122/2557] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:21.317820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:21.318436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:21.324891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:21.325339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:21.326135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:21.326573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:21.335616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:21.336201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:21.342492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:21.342912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:21.344283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:21.344722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:21.423984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:21.435574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2e081de1-7f89-49f8-8148-e299a467030b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.100085 May 05 14:20:21.435574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1123/2558] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:21.482883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:21.490920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-25b2e2a7-faf7-4f0a-b869-5ff9ca68fe13 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.176959 May 05 14:20:21.491482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1436/2559] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:21 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:22.006586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:22.007207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:22.013184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.013638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.014439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.014878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.137013 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:22.144738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7d07e4b8-7872-448e-96a9-ca8a0e5ecaab tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142032 May 05 14:20:22.145307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1124/2560] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:22 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:22.448256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:22.448890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:22.455915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.456368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.457129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.457569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.507787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:22.508404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:22.515138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.516315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.517119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:22.517252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:22.517693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:22.524887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f521296-af03-4456-964f-ddbf4169e30a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080476 May 05 14:20:22.525458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1437/2561] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:22.644320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:22.652015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f79b5ed-7b25-4fa7-b709-ecb76e920799 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148106 May 05 14:20:22.652576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1125/2562] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:22 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:23.161601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:23.162254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:23.168193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.168643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:23.169400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.169862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:23.293121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:23.301041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-47fba37a-3fc4-4279-a850-78ad88aa59c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143286 May 05 14:20:23.301605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1438/2563] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:23 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:23.541563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:23.542151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:23.548953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.549396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:23.550181 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.550616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:23.610817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:23.618411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c8a9d69-f80c-485b-84e9-2e43a08a047d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080713 May 05 14:20:23.618966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1126/2564] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:23.668549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:23.669172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:23.676033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.676483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:23.677245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:23.677684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:24.070681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:24.078560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-321c86c3-66a6-467a-be5c-103b8001547b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.413835 May 05 14:20:24.079133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1439/2565] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:23 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:24.318139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:24.318745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:24.324689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:24.325139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:24.325898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:24.326360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:24.450756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:24.459008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e3c34740-a27e-4f65-8254-4a97386a767e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144771 May 05 14:20:24.459562 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1127/2566] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:24 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:24.635541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:24.636167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:24.642897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:24.643352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:24.644116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:24.644560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:24.706417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:24.714294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88b494ee-7cc7-42fe-b5b5-52a5331f73ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082538 May 05 14:20:24.714862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1440/2567] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:25.095214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:25.095834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:25.102238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.102688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.103444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.103881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.231179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:25.238891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e037ec98-9a1c-4a5b-ad3a-1898d3a46c96 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147506 May 05 14:20:25.239478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1128/2568] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:25 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:25.475957 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:25.476492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:25.482741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.483192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.483948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.484413 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.607826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:25.616094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc302484-5e63-428a-8abd-e7649ec52448 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144094 May 05 14:20:25.616656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1441/2569] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:25.732088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:25.732621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:25.739150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.739612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.740380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:25.740824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:25.806602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:25.815147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a399dd6b-776f-44a0-ab63-a0dd51ad90cf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087413 May 05 14:20:25.815715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1129/2570] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:26.255756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:26.256377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:26.262877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.263330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.264097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.264541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.389441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:26.397804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-69da2b9a-e69f-4844-ba2f-c5417ec5d6ec tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145952 May 05 14:20:26.398408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1442/2571] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:26 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:26.633769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:26.634411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:26.641381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.641778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.642572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.643014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.767304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:26.774991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7a8503c0-3636-40af-92af-227bc38c1d77 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145092 May 05 14:20:26.775550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1130/2572] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:26 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:26.831601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:26.832215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:26.838056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.838505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.839292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:26.839721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:26.902206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:26.909888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a1332419-eb0a-4986-a91f-d6a7892a441c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082905 May 05 14:20:26.910470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1443/2573] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:27.415350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:27.415889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:27.422345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.423128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.424269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.424916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.548833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:27.556591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-57ce01c2-47d7-4a08-ab09-092fedfbbc47 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145193 May 05 14:20:27.557160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1131/2574] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:27 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:27.792178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:27.792741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:27.799086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.799541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.800309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.800751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.925134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:27.927197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:27.927901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:27.932983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ebcf3608-6f93-4fa5-abfa-2d7a4269b4f0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144794 May 05 14:20:27.933555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1444/2575] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:27.934192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.934643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.935404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:27.935843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:27.998200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:28.006528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4ab47109-3193-42d6-8b7c-4e0de57cb3e4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083261 May 05 14:20:28.007090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1132/2576] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:28.572887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:28.573423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:28.580114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:28.580563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:28.581323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:28.581762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:28.707257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:28.714983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a20a53d6-80f5-4e1d-a28e-fe9f6890ca1d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146266 May 05 14:20:28.715545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1445/2577] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:28 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:28.950805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:28.951448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:28.957716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:28.958206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:28.958965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:28.959400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:29.023766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:29.024380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:29.030189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:29.030638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:29.031934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:29.032368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:29.107082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:29.111878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:29.115601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-403ff7aa-5786-4269-addf-80710751f64d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.095621 May 05 14:20:29.116175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1446/2578] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:29.119669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5c4996be-65bd-4ded-bc16-eaee28311957 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.172719 May 05 14:20:29.120224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1133/2579] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:29.731937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:29.732557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:29.742351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:29.742810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:29.743575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:29.744018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:29.871598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:29.880249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-584e563f-f455-46f4-bc0a-131ab4c98671 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152422 May 05 14:20:29.880822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1447/2580] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:29 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:30.132449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:30.133071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:30.136317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:30.136939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:30.139504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.139956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:30.140727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.141166 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:30.142818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.143277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:30.144044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.144485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:30.221840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:30.229560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e2c7ee79-1ab3-4ad9-b273-b5818c968cb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.101049 May 05 14:20:30.230703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1134/2581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:30.289482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:30.297913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d7dd17f8-2143-49c0-b676-cff4b0e21cec tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.165375 May 05 14:20:30.298497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1448/2582] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:30 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:30.897650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:30.898304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:30.904302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.904758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:30.905528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:30.905970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:31.044380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:31.052216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2f0b501-c8d3-4bbc-8ab9-a052f033f276 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.158442 May 05 14:20:31.052972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1135/2583] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:30 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:31.247350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:31.247975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:31.259711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:31.260172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:31.261064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:31.261505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:31.315513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:31.316237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:31.321559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:31.322776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:31.323291 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:31.324124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:31.324625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:31.330152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0deb136a-d9f6-425e-83e0-939d098459f6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086608 May 05 14:20:31.330728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1449/2584] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:31.455266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:31.463188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f3d522a-03ed-4f72-8abb-775b48390794 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.152146 May 05 14:20:31.463757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1136/2585] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:31 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:32.069458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:32.070084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:32.077526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.078093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.078860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.079295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.202527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:32.210286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24c0cde3-8f88-4f31-ac92-b2d358a144be tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144732 May 05 14:20:32.210866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1450/2586] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:32 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:32.347597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:32.348209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:32.356504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.356504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.356504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.356934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.421715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:32.429659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f5adbff-be3b-4d47-9a14-01fcfc136d50 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086301 May 05 14:20:32.430252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1137/2587] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:32.480113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:32.480991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:32.487455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.487911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.488678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:32.489115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:32.615593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:32.623334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ad8c0f7-92a7-470b-a22a-d8d51676dbca tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147051 May 05 14:20:32.623910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1451/2588] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:33.227557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:33.228202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:33.234472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.234923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.235682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.236117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.359420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:33.368060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cf7e6487-6a1b-4a19-975e-1e003d8eff3f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144325 May 05 14:20:33.368917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1138/2589] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:33 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:33.446203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:33.446816 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:33.453370 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.453821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.454607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.455045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.514727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:33.523573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-599511c7-1981-4fd1-8294-a48fe03b10b4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081230 May 05 14:20:33.524156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1452/2590] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:33.640214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:33.641356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:33.647270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.647720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.648482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:33.648921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:33.795061 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:33.802851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-02c75bbd-c897-43c1-80f3-22d62a8fd1fa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.166524 May 05 14:20:33.803403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1139/2591] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:33 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:34.385467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:34.386034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:34.392652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.393103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.393864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.394340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.518850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:34.526628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56f5023f-bdaf-469c-8a24-a581b5014607 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145128 May 05 14:20:34.527200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1453/2592] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:34 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:34.540544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:34.541183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:34.547475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.547929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.548676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.549110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.612078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:34.619815 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0950515e-92c5-480d-b747-b0f974d5757b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083120 May 05 14:20:34.620373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1140/2593] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:34.819884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:34.820434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:34.826400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.826854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.827615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:34.828563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:34.951598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:34.959890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-25d3819f-655d-4070-a0c9-94b548cfa36c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143882 May 05 14:20:34.960461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1454/2594] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:35.543551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:35.544169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:35.552006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.552461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:35.553269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.553713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:35.636494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:35.637118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:35.643536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.643991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:35.644764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.645204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:35.681524 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:35.690252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-39d93246-c353-4a39-8864-ecba967a4aac tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.150478 May 05 14:20:35.690873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1141/2595] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:35 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:35.711417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:35.719841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4b677f29-b93b-44bb-b5dc-792fa2575f5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087155 May 05 14:20:35.720407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1455/2596] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:35.978268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:35.978798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:35.984963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.985409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:35.986212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:35.986648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:36.111351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:36.119044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c95affbc-c616-41e9-9938-bc15ec52bb58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144778 May 05 14:20:36.119614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1142/2597] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:36.707280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:36.707896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:36.714285 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:36.714734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:36.715487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:36.715921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:36.737269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:36.737887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:36.744201 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:36.744649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:36.745413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:36.745852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:36.815097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:36.823266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee2fdc95-50bb-4d08-9305-60b403e83301 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.090384 May 05 14:20:36.823887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1143/2598] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:36.868569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:36.876379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c03b0921-0864-4d66-8754-e0d5b576bf4b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.172955 May 05 14:20:36.876951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1456/2599] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:36 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:37.136865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:37.137512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:37.143967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.144412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.145174 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.145606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.270212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:37.277935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9dad9839-6308-40ab-a836-26dd15c482d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144974 May 05 14:20:37.278525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1144/2600] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:37 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:37.840134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:37.840750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:37.847223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.847676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.848440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.848904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.892654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:37.893387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:37.899877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.900340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.901235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:37.901742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:37.908962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:37.916821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-39beb4b6-1009-462e-aae7-446baa15b6c3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080531 May 05 14:20:37.917597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1457/2601] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:38.030487 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:38.042806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fff515ed-7e42-46e7-bdba-dda597a2080e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.153991 May 05 14:20:38.043397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1145/2602] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:37 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:38.295135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:38.295680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:38.302262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:38.302717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:38.303478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:38.303919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:38.430616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:38.438554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cca1c995-e741-402e-b486-11f4923831d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147298 May 05 14:20:38.439162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1458/2603] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:38.934232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:38.934863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:38.941155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:38.941601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:38.942389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:38.942820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:39.002696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:39.010468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d06322c5-e408-42f4-b912-ebbdbb8981be tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080163 May 05 14:20:39.011036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1146/2604] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:39.060397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:39.061128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:39.067488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:39.067944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:39.068710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:39.069157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:39.196924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:39.205207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec293c1b-f5ff-4b87-93fd-ebf6633a31ef tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148600 May 05 14:20:39.205774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1459/2605] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:39 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:39.456109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:39.456639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:39.462579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:39.463024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:39.463774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:39.464212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:39.588076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:39.596316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-abde054a-ede0-4c00-903d-9bd6cb69f363 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144133 May 05 14:20:39.596880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1147/2606] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:39 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:40.027192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:40.027806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:40.034344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.034800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.035556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.035987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.124410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:40.132404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-95646692-9653-4d5f-99c5-8abd463c8c5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.109010 May 05 14:20:40.132970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1460/2607] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:40.221714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:40.222450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:40.228921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.229352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.230140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.230845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.429194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:40.437588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-10ae6558-9ebf-486e-83e5-76b6881b262b tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.219833 May 05 14:20:40.438389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1148/2608] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:40 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:40.613805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:40.614487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:40.620444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.620898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.621696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:40.622167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:40.750921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:40.758634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-51507d99-1b23-4f27-b688-5f54c2fe9759 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149424 May 05 14:20:40.759204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1461/2609] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:41.149030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:41.149651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:41.155683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.156136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.156894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.157332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.216326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:41.224068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d6128500-30ef-49b0-ae7e-9777a8715f31 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078907 May 05 14:20:41.225106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1149/2610] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:41.454583 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:41.455123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:41.461407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.461855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.462666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.463088 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.590104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:41.597883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e3bc30a-8332-4720-842f-1f8855f7f536 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147317 May 05 14:20:41.598495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1462/2611] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:41 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:41.775688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:41.776224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:41.783102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.783556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.784320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:41.784752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:41.912653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:41.920370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7f76e5a5-e8ef-4b0e-9e4c-a82342429245 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148625 May 05 14:20:41.920929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1150/2612] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:42.240716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:42.241462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:42.247715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.248177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:42.248944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.249392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:42.313417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:42.321492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f88c5489-2157-488f-8f88-1da710cdd7f1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084640 May 05 14:20:42.322102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1463/2613] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:42.619004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:42.619645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:42.625492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.625940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:42.627235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.627668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:42.750663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:42.758950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cfd01edd-7089-4eaf-b99d-d45a854729dd tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143797 May 05 14:20:42.759518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1151/2614] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:42 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:42.938482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:42.939073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:42.945636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.946149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:42.946918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:42.947358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:43.074799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:43.082594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc754532-adb3-4ce7-80aa-825791f49e6f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148517 May 05 14:20:43.083156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1464/2615] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:43.338280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:43.338904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:43.345945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:43.346426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:43.347207 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:43.347647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:43.406667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:43.414848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1eef1819-cbbd-4b49-be9e-8f26366cdc59 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080407 May 05 14:20:43.415416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1152/2616] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:43.777429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:43.778501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:43.787066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:43.787522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:43.788292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:43.788752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:43.913379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:43.921308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e75f1663-f99e-4d90-b018-74b730f32fd8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149304 May 05 14:20:43.921873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1465/2617] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:43 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:44.099761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:44.100542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:44.106940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.107397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:44.108171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.108613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:44.236162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:44.243946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d75163fd-fa2d-4dce-aeb5-ac70758a1858 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148151 May 05 14:20:44.244513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1153/2618] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:44 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:44.432110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:44.432665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:44.439640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.440086 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:44.440840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.441274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:44.499802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:44.509358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-21891cd2-59fb-45df-b05a-7e2b12fc1ace tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081142 May 05 14:20:44.509930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1466/2619] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:44.941082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:44.941701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:44.948049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.948499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:44.949257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:44.949697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:45.073058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:45.081371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-68dafae3-1ba5-4573-bb93-24da6d0dc073 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.144137 May 05 14:20:45.081928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1154/2620] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:44 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:45.261558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:45.262145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:45.268794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:45.269250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:45.270033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:45.270476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:45.396845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:45.404669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-54026048-fcaf-4051-8023-4c83bf60ef45 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146958 May 05 14:20:45.405267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1467/2621] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:45 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:45.525889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:45.526480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:45.532420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:45.532870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:45.533629 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:45.534089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:45.593003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:45.600974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ef59d568-5681-4dcc-bc5f-2abf27196dc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078952 May 05 14:20:45.601550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1155/2622] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:46.098179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:46.098780 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:46.105141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.105868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.106659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.107103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.234534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:46.242875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6dd454e8-b7d6-4e48-aeeb-0b33fb87a229 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148590 May 05 14:20:46.243447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1468/2623] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:46 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:46.421703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:46.422240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:46.429133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.429581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.430364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.430801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.554467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:46.562310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-754b2e48-9f68-43cf-a422-f07b13db08c1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144455 May 05 14:20:46.562880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1156/2624] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:46 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:46.617974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:46.618627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:46.624480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.624934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.625699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:46.626181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:46.684813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:46.692706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1c4acf9c-44ae-4222-8c36-d91faeee9fd4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078595 May 05 14:20:46.693280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1469/2625] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:47.259913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:47.260533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:47.266537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.267045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.267810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.268251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.397406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:47.405448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d12986ff-eefe-4182-b309-dc259b933579 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.149355 May 05 14:20:47.405991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1157/2626] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:47 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:47.579210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:47.580347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:47.586734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.587179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.587931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.588363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.712345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:47.712971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:47.718435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:47.720483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.721030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.721809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:47.722279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:47.726247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-36724d29-9382-4aa8-bd6c-02d0ecf0be17 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150840 May 05 14:20:47.726811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1470/2627] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:47.782881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:47.790510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2894376a-106f-4354-86d4-0604d37e801d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084100 May 05 14:20:47.791070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1158/2628] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:48.422300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:48.422834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:48.428809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.429264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.430039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.430495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.556018 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:48.564457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a36650e-faa7-4172-8124-70361fa1bd8c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145595 May 05 14:20:48.565119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1471/2629] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:48 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:48.743678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:48.744297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:48.750622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.751070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.752451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.752892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.806472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:48.807124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:48.813388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.817763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.817763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:48.817763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:48.882853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:48.890784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-32a0d31c-c6b0-422f-b544-7e75e0f926a7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088240 May 05 14:20:48.891351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1472/2630] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:48.903833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:48.911868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e6aa995a-cc9b-4252-b4b8-070febf25082 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.172073 May 05 14:20:48.912483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1159/2631] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:49.582164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:49.582859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:49.589139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.589592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.590395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.590830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.716615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:49.724732 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3f796dac-307c-4a24-be09-3d2ca681f9b8 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.147257 May 05 14:20:49.725300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1473/2632] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:49 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:49.908538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:49.909085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:49.915064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.915509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.916356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.916790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.929017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:49.929634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:49.935911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.936361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.937125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:49.937561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:49.980902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:49.989707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9cd6ec59-c295-48ca-a6b1-691f95bae03f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085224 May 05 14:20:49.990352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1160/2633] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:50.069568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:50.077342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a5956c7-6639-4c05-9735-833b17f7b86f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.152203 May 05 14:20:50.077898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1474/2634] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:50.742558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:50.743178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:50.749171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:50.749627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:50.750433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:50.750881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:50.876070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:50.883741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-84ed77f3-ca32-471e-978c-17ddbed86e9c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145042 May 05 14:20:50.884303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1161/2635] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:50 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:51.006262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:51.006812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:51.013272 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.013707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:51.014510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.014981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:51.073940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:51.082183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0a0f620a-8129-4523-8fe7-4707e5395d3a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079801 May 05 14:20:51.082749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1475/2636] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:51.093272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:51.093891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:51.100987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.101440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:51.102240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.102704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:51.224889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:51.232857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-456a4ac4-04cc-4a20-a4ac-affbea605c9c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143403 May 05 14:20:51.233420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1162/2637] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:51.900564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:51.901209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:51.907196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.908309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:51.909068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:51.909502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:52.034741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:52.042444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56174009-036d-4edc-925a-1b48764936d6 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145716 May 05 14:20:52.043007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1476/2638] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:51 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:52.099257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:52.099880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:52.106577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:52.107033 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:52.107802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:52.108242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:52.167705 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:52.175486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-14c18538-942e-4369-b414-c8d22ff84ccc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080654 May 05 14:20:52.176057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1163/2639] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:52.249772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:52.250444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:52.256955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:52.257396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:52.258177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:52.258608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:52.383947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:52.392536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9867c1c1-a54e-45c9-adf5-816f03529d52 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145918 May 05 14:20:52.393100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1477/2640] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:53.059437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:53.060185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:53.066322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.066775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.067564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.067998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.191336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:53.192420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:53.193033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:53.199072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.199399 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-584987bf-266e-4f1b-a76c-dbdb6b7d9e01 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.143814 May 05 14:20:53.199530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.199973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1164/2641] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:53 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:53.200295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.200729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.261098 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:53.268782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aec2d9ca-4cab-4206-8076-a99eebd1ec90 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080068 May 05 14:20:53.269340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1478/2642] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:53.409552 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:53.410195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:53.416101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.416553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.417315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:53.417762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:53.542513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:53.550269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1f4afcb5-2edf-4bf5-8951-aa51ef21a705 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145128 May 05 14:20:53.550837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1165/2643] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:53 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:54.216410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:54.217021 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:54.224004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.224450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.225207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.225640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.285274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:54.285891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:54.292261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.292714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.293484 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.293922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.361698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:54.369382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75a3a863-7895-4832-b840-07dcd34f86bd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088580 May 05 14:20:54.372870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1166/2644] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:20:54.373059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:54.380503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1da0cd89-e1de-4bb3-83cd-26c29f0ea1e4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.168023 May 05 14:20:54.381062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1479/2645] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:54 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:54.567730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:54.568353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:54.574311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.574778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.575534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:54.575974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:54.705472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:54.713156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6498886-2b55-4dae-a19a-cb4bef7de59e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149388 May 05 14:20:54.713716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1167/2646] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:55.385848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:55.386419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:55.392727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.393710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.393932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.394392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.400176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:55.404904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:55.411570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.412023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.412797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.413234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.461266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:55.469339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f4ad41a4-01c5-47d4-9a78-db873168d22b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087365 May 05 14:20:55.470535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1480/2647] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:55.551051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:55.558750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aae90aaf-6c63-458d-a999-77193003dd6c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.165984 May 05 14:20:55.559350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1168/2648] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:55 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:55.730339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:55.731140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:55.737127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.737584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.738401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:55.738844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:55.870244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:55.878288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2516fab-52d9-4b2f-9514-ce9d8e828a43 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151922 May 05 14:20:55.878858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1481/2649] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:56.486765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:56.487301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:56.493764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.494259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:56.495026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.495469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:56.554409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:56.562238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d60dbac6-47c2-4b83-904e-8f2ea38d81a9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079819 May 05 14:20:56.562804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1169/2650] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:56.575638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:56.576256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:56.582725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.583176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:56.583941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.584397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:56.724029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:56.732015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d8e99b87-ba0d-4566-a1ca-cd53bf34af0e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.160195 May 05 14:20:56.732577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1482/2651] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:56 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:56.895441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:56.896077 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:56.902098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.902556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:56.903325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:56.903773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:57.030991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:57.039348 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f6a311ba-67d3-4c15-84af-ea3816f642b4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147849 May 05 14:20:57.044329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1170/2652] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:57.579488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:57.580113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:57.586542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:57.587001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:57.587768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:57.588210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:57.648270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:57.656111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aca245cc-cddc-4218-8b88-85fe0778ad2c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080436 May 05 14:20:57.656686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1483/2653] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:57.749257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:57.749872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:57.756272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:57.756709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:57.757499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:57.757937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:57.891156 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:57.899651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0cf4506e-2b40-45d2-99ab-2d7ea9de37ff tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.154248 May 05 14:20:57.900219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1171/2654] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:57 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:58.059846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:58.060457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:58.066979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.067426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:58.068180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.068613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:58.190701 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:58.198349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a058cdd-2ae2-4b9c-9f98-7e5dd74a3bc5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142478 May 05 14:20:58.198917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1484/2655] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:58.672549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:58.673198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:58.679255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.679711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:58.680471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.680910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:58.740021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:58.747791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c32ebb5-416a-46f0-94f5-bdb8df9703e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079139 May 05 14:20:58.748351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1172/2656] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:58.916999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:58.917615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:58.924234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.924616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:58.925369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:58.925949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:59.051314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:59.059541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc7de6f4-a908-42d8-8562-da34f036f7ea tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146537 May 05 14:20:59.060110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1485/2657] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:58 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:59.214393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:59.215018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:59.221990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:59.222462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:59.223225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:59.223665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:59.355497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:59.363601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-894e8bc2-ccc9-4159-87b8-b01ec193599d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.153021 May 05 14:20:59.364170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1173/2658] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:20:59.763704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:20:59.764374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:20:59.770948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:59.771395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:59.772145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:20:59.772578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:20:59.831539 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:20:59.839375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-846c7847-fac0-4670-b344-9b66b83f8bbc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079473 May 05 14:20:59.839939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1486/2659] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:20:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:00.076378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:00.076988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:00.083000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.083447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.084203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.084640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.210099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:00.217802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b5e7fef6-4e27-4e0f-a4b5-e4f949b0c733 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.145389 May 05 14:21:00.218413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1174/2660] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:00 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:00.380567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:00.381105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:00.387455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.387917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.388676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.389114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.512779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:00.521123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3590aa5c-1ec7-4373-845e-2baec58c3df0 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144494 May 05 14:21:00.521688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1487/2661] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:00 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:00.856124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:00.856765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:00.863745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.864224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.864996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:00.865437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:00.925096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:00.932851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4fbb8a2f-05f8-4f89-85cd-19d32ed5194c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080865 May 05 14:21:00.933418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1175/2662] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:01.235932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:01.236551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:01.242489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.242941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:01.243704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.244144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:01.370003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:01.378334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2bfb9ac6-b9d0-4aa8-9e9c-e5c78ef871ee tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.146692 May 05 14:21:01.378903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1488/2663] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:01 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:01.538800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:01.539367 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:01.545326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.545780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:01.546581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.547019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:01.672512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:01.680964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-27ec91f1-0156-4309-bb3a-6873fd6538b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146231 May 05 14:21:01.681537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1176/2664] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:01.950385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:01.950992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:01.958179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.958626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:01.959419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:01.959853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:02.018687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:02.026305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-be53d86f-eafa-40a9-a369-bbf7543a49c9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079760 May 05 14:21:02.026864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1489/2665] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:02.396249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:02.396863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:02.403249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:02.403708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:02.404501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:02.404940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:02.533483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:02.541243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-62936f1d-e02f-48d6-ae58-27e22c851391 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.148855 May 05 14:21:02.541824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1177/2666] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:02 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:02.698842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:02.699486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:02.705489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:02.705934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:02.706716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:02.707151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:02.829540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:02.837284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c7aa33a6-783d-4b00-ac06-3929c342e9d4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142422 May 05 14:21:02.837849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1490/2667] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:03.043253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:03.043782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:03.052936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.053386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.054177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.054615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.117322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:03.125184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-847dd610-4cbd-4809-8da0-1c1157d1633a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085950 May 05 14:21:03.125762 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1178/2668] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:03.558749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:03.559373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:03.565764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.566263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.567027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.567468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.698733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:03.707010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b48c6fc-ed05-4e98-9a14-faf68e8b1a4c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.152161 May 05 14:21:03.707573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1491/2669] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:03 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:03.854624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:03.855253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:03.862420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.862880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.863648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:03.864092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:03.995630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:04.009142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-671ce81e-3f67-4b77-be27-e68133f64c83 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158321 May 05 14:21:04.009710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1179/2670] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:04.141771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:04.142360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:04.148361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:04.148814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:04.149571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:04.150029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:04.211674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:04.219414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3e7b1d05-5091-4295-a24c-bdf7e688f220 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081536 May 05 14:21:04.220513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1492/2671] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:04.724053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:04.724667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:04.730544 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:04.731245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:04.731998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:04.732434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:05.026332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:05.026867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:05.033332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:05.033795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:05.034589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:05.035031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:05.155125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:05.163213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95e7638e-e0fa-450e-bce7-da56f7fab872 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.443380 May 05 14:21:05.163867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1180/2672] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:04 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:05.182518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:05.191135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-22a4a6ef-8730-4e03-9a13-ea8cb5e1d7f1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.168777 May 05 14:21:05.191699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1493/2673] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:05 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:05.236640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:05.237254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:05.243102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:05.243548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:05.244303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:05.244737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:05.306173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:05.314528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d48c7a61-29dc-4a1d-a792-803a6124c41f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081666 May 05 14:21:05.315088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1181/2674] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:06.180287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:06.180899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:06.187335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.187778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.188566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.189001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.208951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:06.209571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:06.215921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.216369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.217125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.217565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.370230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:06.378534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fee56d38-e27b-48ae-826a-0a2cf586c4f2 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.201861 May 05 14:21:06.379213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1494/2675] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:06 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:06.383649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:06.384256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:06.384390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:06.390045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.390501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.391260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:06.392205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:06.393180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bfdf60fd-2b07-4ec4-b1e4-9a4ceabc613e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.188113 May 05 14:21:06.393751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1182/2676] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:06.455543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:06.463239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5070f6e9-09e9-4f8b-8aab-197e108ea42b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083106 May 05 14:21:06.463799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1495/2677] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:07.396216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:07.396836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:07.403197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.404510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.404510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.404868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.410185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:07.411487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:07.417797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.418284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.419053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.419492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.587534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:07.596232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a1116fd9-7a7e-47eb-acae-4687db532123 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.204539 May 05 14:21:07.596895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1183/2678] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:07 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:07.600584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:07.606593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:07.606593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:07.608378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.608827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.609591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:07.609950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c10c7d6-efb3-41d6-9a1f-ef609bba192e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.203442 May 05 14:21:07.610184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:07.610650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1496/2679] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:07 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:07.675994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:07.684003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4ecf7b0b-f109-4610-8daa-420cc4de3021 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086053 May 05 14:21:07.684598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1184/2680] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:08.613895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:08.614552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:08.621039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.621487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.622279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.622717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.627106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:08.627748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:08.633948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.634433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.635371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.635816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.797799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:08.805952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4d01265b-25db-4b5b-a229-a40748594d09 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.195832 May 05 14:21:08.807384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1497/2681] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:08 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:08.811182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:08.811789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:08.818043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.818520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.819232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:08.819382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:08.819717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:08.827363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ac057507-e19e-4569-880f-ff034bbd643c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.204106 May 05 14:21:08.827920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1185/2682] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:08 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:08.883630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:08.891618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ca6a59e-d918-43a9-8922-cb33456b85ee tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083988 May 05 14:21:08.892181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1498/2683] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:09.823569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:09.824187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:09.830692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:09.831149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:09.831945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:09.832395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:09.844510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:09.845129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:09.851417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:09.851871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:09.852634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:09.853074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:10.028731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:10.036540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee8b617a-f2bb-42a5-a6c0-93740d7f8699 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a" status: 200 len: 1733 microversion: 2.1 time: 0.216805 May 05 14:21:10.037109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1186/2684] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:09 2022] GET /compute/v2.1/servers/5ff0825e-cbd9-44da-a2f8-c5efaf38e30a => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:10.041471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:10.042259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:10.042385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:10.048070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:10.048529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:10.049835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:10.050301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:10.055226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e3f39589-9be5-4359-a644-3b6c34f4ab23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.214518 May 05 14:21:10.056017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1499/2685] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:10.060803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ab2d7204-4652-48d9-a530-050610ed6f5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '.version_select at 0x7fb4e2e27d30>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:10.117777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:10.123505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a3b63419-37d5-42ef-b654-de460f903293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085473 May 05 14:21:10.124072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1187/2686] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:10.136074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ab2d7204-4652-48d9-a530-050610ed6f5f tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-648379655" status: 202 len: 0 microversion: 2.1 time: 0.078754 May 05 14:21:10.136651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1500/2687] 10.222.0.26 () {58 vars in 1217 bytes} [Thu May 5 14:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-648379655 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:21:11.073383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:11.074297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:11.082471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:11.082927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:11.083733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:11.084208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:11.141189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:11.141963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:11.149623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:11.150776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:11.151564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:11.152041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:11.224979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:11.234301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88b5dd35-70de-4959-a457-ce1eb6d0930a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.097577 May 05 14:21:11.234881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1501/2688] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:11.241201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-fc8a7018-7ee4-49e4-be33-69b7b21c71cf req-d6fe3f7e-982c-4925-891e-80ad1a838d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:21:11.249618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-fc8a7018-7ee4-49e4-be33-69b7b21c71cf req-d6fe3f7e-982c-4925-891e-80ad1a838d72 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:11.250092 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-fc8a7018-7ee4-49e4-be33-69b7b21c71cf req-d6fe3f7e-982c-4925-891e-80ad1a838d72 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:11.262119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-fc8a7018-7ee4-49e4-be33-69b7b21c71cf req-d6fe3f7e-982c-4925-891e-80ad1a838d72 service nova] Creating event network-changed:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 14:21:11.268190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-fc8a7018-7ee4-49e4-be33-69b7b21c71cf req-d6fe3f7e-982c-4925-891e-80ad1a838d72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031127 May 05 14:21:11.268791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1502/2689] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:21:11.422254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:11.431041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6b21ddad-f165-4d5b-8b03-94b9e4d4f354 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.361664 May 05 14:21:11.441256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1188/2690] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:11 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:12.252716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:12.254043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:12.261206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:12.261805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:12.262489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:12.263095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:12.332858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:12.341250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-04276c70-3483-4a21-a16e-ef74917f7bf4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093283 May 05 14:21:12.341829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1503/2691] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:12.448956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:12.449687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:12.456264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:12.456716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:12.457515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:12.457951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:12.585130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:12.593105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-adbafd70-62cc-481a-8d60-d50ee0f03cf1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148283 May 05 14:21:12.593665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1189/2692] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:12 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:13.352908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-b816dcea-ac55-4448-9ee3-2bc02ae82656 req-0b16fbde-36b9-4d97-94b6-0afd82949ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0825e-cbd9-44da-a2f8-c5efaf38e30a", "name": "network-vif-deleted", "tag": "33675a7a-a600-4850-b232-cee945437d20"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:21:13.358519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:13.359144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:13.362519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b816dcea-ac55-4448-9ee3-2bc02ae82656 req-0b16fbde-36b9-4d97-94b6-0afd82949ac5 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:13.365735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b816dcea-ac55-4448-9ee3-2bc02ae82656 req-0b16fbde-36b9-4d97-94b6-0afd82949ac5 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:13.365860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:13.366110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:13.367056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:13.367327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:13.373929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-b816dcea-ac55-4448-9ee3-2bc02ae82656 req-0b16fbde-36b9-4d97-94b6-0afd82949ac5 service nova] Creating event network-vif-deleted:33675a7a-a600-4850-b232-cee945437d20 for instance 5ff0825e-cbd9-44da-a2f8-c5efaf38e30a on hv-cinder-73761 May 05 14:21:13.379300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-b816dcea-ac55-4448-9ee3-2bc02ae82656 req-0b16fbde-36b9-4d97-94b6-0afd82949ac5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030267 May 05 14:21:13.380068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1504/2693] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:21:13.429350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:13.438239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c301e0c5-0e15-4e57-bb87-2fc5c2b996a8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083707 May 05 14:21:13.438769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1190/2694] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:13.611174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:13.611881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:13.618072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:13.618523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:13.619308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:13.619748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:13.753202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:13.761295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ad6dec1-f96b-40cf-b4fb-9b1f553bae7d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154344 May 05 14:21:13.761870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1505/2695] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:14.454685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:14.455228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:14.461496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:14.461940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:14.462728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:14.463163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:14.527385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:14.535148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-efac8cb7-c7b4-4810-ab98-3d20203cd727 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084398 May 05 14:21:14.535707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1191/2696] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:14.778590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:14.779138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:14.786043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:14.786496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:14.787262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:14.787706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:14.916227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:14.926689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9677cb4e-31d5-4d96-8940-52bdae347a9b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151568 May 05 14:21:14.927706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1506/2697] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:14 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:15.551985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:15.552532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:15.558822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:15.559270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:15.560026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:15.560463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:15.619696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:15.627935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-87760ec0-301f-4b86-aa18-9ccedc077859 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079931 May 05 14:21:15.628495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1192/2698] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:15.946759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:15.947490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:15.954610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:15.955574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:15.956554 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:15.956997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:16.088929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:16.096755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-66a4d46d-0f3b-4dd5-b480-258b0c1e3e35 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154018 May 05 14:21:16.097338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1507/2699] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:15 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:16.645105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:16.645729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:16.652125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:16.652586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:16.653355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:16.653798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:16.713501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:16.721911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-68acabd9-8a37-4ef8-979f-3e600b1123aa tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081117 May 05 14:21:16.722507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1193/2700] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:17.113916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:17.122347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:17.122347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:17.122347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:17.122347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:17.122766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:17.249265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:17.257051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-772a222f-16cc-456c-99f5-d67a49e2abfd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146999 May 05 14:21:17.257614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1508/2701] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:17.738856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:17.739481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:17.745919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:17.746408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:17.747175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:17.747618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:17.810208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:17.818528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe625cc3-9796-4a2d-8ff6-8e3e594b0000 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083525 May 05 14:21:17.819087 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1194/2702] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:17 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:18.274269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:18.274887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:18.281134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:18.281582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:18.282363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:18.282806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:18.414447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:18.424733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d8e0209a-d1e8-415c-bf2b-ac0e1bac63ef tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154195 May 05 14:21:18.425722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1509/2703] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:18 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:18.835117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:18.835729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:18.842029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:18.842512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:18.843273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:18.843718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:18.903574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:18.912140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-55b72fb6-a63c-4e1f-abc8-edaeea7c2300 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080979 May 05 14:21:18.912711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1195/2704] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:19.441340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:19.441892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:19.448177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:19.448623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:19.449382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:19.449817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:19.574802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:19.582999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7425e493-cfdd-4788-9a1d-8c97e92ed84c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145630 May 05 14:21:19.583567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1510/2705] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:19 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:19.929067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:19.929693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:19.935818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:19.936275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:19.937075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:19.937517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:20.001229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:20.013988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d2287eff-abee-43e8-9c56-6dc20f6103a4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088794 May 05 14:21:20.014618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1196/2706] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:20.600729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:20.601339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:20.607898 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:20.608345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:20.609097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:20.609531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:20.734819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:20.743154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dd3db2ca-1908-46d7-a1b7-1b0e02601ade tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146233 May 05 14:21:20.743717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1511/2707] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:21.032048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:21.032591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:21.039517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:21.039975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:21.040971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:21.042233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:21.104765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:21.112846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-19baba3d-a960-4295-ac97-3dd37c13ce7b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084815 May 05 14:21:21.113407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1197/2708] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:21.760289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:21.760905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:21.767241 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:21.767692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:21.768453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:21.768892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:21.890914 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:21.899160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-692e7347-b76e-4897-bba7-a3d847142f56 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142747 May 05 14:21:21.899724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1512/2709] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:21 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:22.129545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:22.130197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:22.136546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:22.137000 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:22.137761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:22.138236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:22.198768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:22.206702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-51fb2c29-6b9e-4b18-831f-be1242f90dce tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081545 May 05 14:21:22.207349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1198/2710] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:22.916577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:22.917196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:22.923703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:22.924156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:22.924923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:22.925381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:23.052522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:23.060281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f2a58e97-d777-41ea-a1e5-17d94a5ff24b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147491 May 05 14:21:23.060849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1513/2711] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:22 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:23.223433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:23.224044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:23.230388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:23.231094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:23.231843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:23.232274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:23.291014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:23.299283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8e8131b6-a60c-4f8f-b2b3-d9e8d9401fb8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079721 May 05 14:21:23.299835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1199/2712] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:24.078127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:24.078745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:24.085622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:24.086110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:24.086873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:24.087313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:24.211438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:24.219270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1f6d4439-0ebc-4f8a-b4d3-7cb0f84ae467 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144948 May 05 14:21:24.219831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1514/2713] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:24 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:24.315568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:24.316190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:24.322557 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:24.323014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:24.323782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:24.324226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:24.387175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:24.395522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0b4ebdc-7d79-46bb-8f37-0da5f87cd208 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083820 May 05 14:21:24.396093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1200/2714] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:25.236704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:25.237316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:25.243655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:25.244108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:25.244869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:25.245307 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:25.368446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:25.376175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6e158c3c-357d-4a2c-a363-9dec11df093b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143280 May 05 14:21:25.377260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1515/2715] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:25.412310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:25.413015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:25.421636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:25.422127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:25.422910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:25.423353 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:25.483744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:25.491525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c54e2b47-97eb-4ca5-9c92-c666c7416655 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083056 May 05 14:21:25.492096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1201/2716] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:26.394293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:26.395499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:26.402032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:26.402491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:26.403252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:26.403688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:26.507858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:26.508506 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:26.514913 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:26.515365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:26.516131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:26.516570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:26.530204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:26.538572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c81ff995-95f8-476a-adac-2d52e029df21 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148778 May 05 14:21:26.539136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1516/2717] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:26 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:26.576932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:26.585269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8ed4c6a5-e6c6-4d75-ae08-2cd973ce69d1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081242 May 05 14:21:26.585833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1202/2718] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:27.555756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:27.556286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:27.562630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:27.563084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:27.563897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:27.564351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:27.602031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:27.602701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:27.609466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:27.609902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:27.611498 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:27.611946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:27.684692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:27.692412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4241a05c-0a16-450e-90e0-d41f0cb97f65 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.094217 May 05 14:21:27.692977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1203/2719] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:27 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:27.712265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:27.719916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31c5efd2-4fb9-4b3c-89e8-2050a90ba46b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.168166 May 05 14:21:27.720976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1517/2720] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:28.709667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:28.710314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:28.716729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:28.717186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:28.717952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:28.718420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:28.737023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:28.737636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:28.743579 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:28.744025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:28.744781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:28.745212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:28.782267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:28.790845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1d6e4bc-1a60-44df-a645-f4a1e354a670 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084990 May 05 14:21:28.791431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1204/2721] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:28.874072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:28.881825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1aded38d-51cd-476f-b3fc-2c1e5a770e50 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148641 May 05 14:21:28.884031 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1518/2722] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:29.807284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:29.807945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:29.814390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:29.814858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:29.815628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:29.816071 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:29.875413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:29.883208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0af98fa1-cbd6-4426-aad8-5953b78c0188 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079803 May 05 14:21:29.883774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1205/2723] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:29.898269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:29.898882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:29.905284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:29.905735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:29.906561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:29.906997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:30.041490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:30.049915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e5e8149-9088-4319-bc08-97e9759ec0d8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.155499 May 05 14:21:30.050507 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1519/2724] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:29 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:30.900437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:30.901073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:30.907538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:30.908564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:30.909317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:30.909754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:30.974407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:30.982542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3a4a9031-ef6e-451d-92aa-8344c6e3341e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085984 May 05 14:21:30.983105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1206/2725] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:31.066972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:31.067593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:31.073968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:31.074528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:31.075287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:31.075727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:31.198537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:31.206465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-98c68013-3861-43ef-a814-7642d2d56b24 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143345 May 05 14:21:31.207029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1520/2726] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:31 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:31.999693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:32.000366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:32.006779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:32.007226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:32.007990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:32.008427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:32.070420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:32.078161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dde595a9-adad-4fa3-9c36-19c681a2aef8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082419 May 05 14:21:32.078734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1207/2727] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:32.224319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:32.224932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:32.231547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:32.231992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:32.232746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:32.233176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:32.359143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:32.366949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac14e257-7868-47f8-9b56-bb08336a45aa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147034 May 05 14:21:32.367505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1521/2728] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:33.094286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:33.094901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:33.101334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:33.101779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:33.102573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:33.103007 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:33.162194 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:33.169775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e2455c2b-628c-480b-89e3-322ac2d68791 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079494 May 05 14:21:33.170375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1208/2729] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:33.383990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:33.384538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:33.390927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:33.391384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:33.392152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:33.393121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:33.525860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:33.533657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aa253be4-cdc1-4747-ae8e-b9cf91111694 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.153640 May 05 14:21:33.534252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1522/2730] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:33 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:34.187031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:34.187689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:34.194038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:34.194505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:34.195276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:34.195721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:34.254864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:34.262569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dbe11ba2-4a06-4b15-94dd-38e8d943a464 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079486 May 05 14:21:34.263130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1209/2731] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:34.551392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:34.551946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:34.558232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:34.558679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:34.559433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:34.559868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:34.682569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:34.690819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2190fddc-315f-4f64-9de4-663b48935a10 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143914 May 05 14:21:34.691384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1523/2732] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:35.279183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:35.279794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:35.286107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:35.286553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:35.287314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:35.287745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:35.354783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:35.363295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7eaab08b-2fde-4942-b3d5-8f2b51ac2965 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087917 May 05 14:21:35.363863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1210/2733] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:35.708351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:35.708913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:35.715335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:35.715786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:35.716544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:35.716993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:35.840983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:35.849364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-13118fbd-f959-467e-a9f7-f69aee9deeb1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144991 May 05 14:21:35.849927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1524/2734] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:36.381135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:36.381688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:36.388059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:36.388515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:36.389301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:36.389735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:36.450763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:36.459164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7353f851-0da5-4a39-a797-fba8905611af tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082207 May 05 14:21:36.459725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1211/2735] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:36.867331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:36.867958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:36.874342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:36.874798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:36.875564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:36.876007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:37.003186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:37.010958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cbf71bb1-fa4b-4f04-9500-f59ac22d2d1d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147550 May 05 14:21:37.011543 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1525/2736] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:36 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:37.475848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:37.476511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:37.483200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:37.483652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:37.484416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:37.484854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:37.545081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:37.553535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9803800d-7660-4564-8e95-b05ebfabe6fe tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081673 May 05 14:21:37.554132 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1212/2737] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:38.032717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:38.033313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:38.039686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:38.040134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:38.040893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:38.041326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:38.167252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:38.175188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e9bfe0aa-1b8d-4d98-9191-f4805a1da038 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150797 May 05 14:21:38.175758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1526/2738] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:38.570767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:38.571364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:38.577757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:38.580547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:38.580547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:38.580547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:38.644228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:38.651936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-640c9c67-424b-4db7-a2f4-f044b6c5691d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085086 May 05 14:21:38.652501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1213/2739] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:38 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:39.191464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:39.192083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:39.199022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:39.199472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:39.200235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:39.200674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:39.322726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:39.330971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b366e09a-6ec7-4dfc-8522-458d47cf5bff tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143403 May 05 14:21:39.331531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1527/2740] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:39 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:39.669014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:39.669657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:39.675969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:39.676415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:39.677171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:39.677604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:39.740493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:39.748157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f47496dc-cb4f-4905-a98c-d3a2bafdf4f5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082989 May 05 14:21:39.748716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1214/2741] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:40.348305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:40.348952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:40.355334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:40.355725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:40.356743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:40.357175 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:40.486793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:40.494561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fb9840f5-b90e-4e05-aafb-42fbccc756db tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150743 May 05 14:21:40.495124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1528/2742] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:40.765319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:40.765872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:40.772702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:40.773148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:40.773902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:40.774356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:40.840535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:40.848905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-04c2fe9a-bc32-4159-9cab-8c3702f80e53 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087510 May 05 14:21:40.849474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1215/2743] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:41.511795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:41.512395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:41.518708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:41.519160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:41.519931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:41.520369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:41.649910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:41.657710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bbd99ee7-124e-44f9-9cdf-afbfd61fa43c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149798 May 05 14:21:41.658944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1529/2744] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:41.866090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:41.866757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:41.873387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:41.873845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:41.874639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:41.875082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:41.935026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:41.942852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d68590d-ec03-40f2-96d8-404f2e7748a2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080778 May 05 14:21:41.943425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1216/2745] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:42.675332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:42.675985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:42.682863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:42.683316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:42.684211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:42.684522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:42.811872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:42.820189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b24615d-9a6b-46ca-9396-90bf0a6acae3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148781 May 05 14:21:42.820786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1530/2746] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:42.959574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:42.960120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:42.966738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:42.967187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:42.967950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:42.968464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:43.028818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:43.036772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bca88ec5-7b5d-4151-8597-6318cf07a21c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081134 May 05 14:21:43.037335 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1217/2747] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:43.837208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:43.837857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:43.844267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:43.844720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:43.846143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:43.846585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:44.053615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:44.054326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:44.060998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:44.061459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:44.062273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:44.062718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:44.195352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:44.203253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf21bb62-d796-4081-a781-c48920b16b02 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.153621 May 05 14:21:44.203837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1218/2748] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:44.250180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:44.258498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5149e1cf-6ec1-4782-928b-0f1412ee0dde tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.425052 May 05 14:21:44.259060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1531/2749] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:43 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:45.221111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:45.221741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:45.228220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:45.228677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:45.229448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:45.229891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:45.276025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:45.276637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:45.283832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:45.284629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:45.286038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:45.286823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:45.289853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:45.298111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-274cb2fe-196f-4861-94fa-bdf7c1d2bc61 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081369 May 05 14:21:45.299206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1219/2750] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:45.421492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:45.429350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-84eb3451-9be3-4d3e-85d5-81a19b158550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.157167 May 05 14:21:45.430150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1532/2751] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:45 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:46.314531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:46.315214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:46.321600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:46.322073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:46.322838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:46.323274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:46.383407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:46.391192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-867d2e3c-8afa-44f2-a6bf-5e7364d30762 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080590 May 05 14:21:46.391757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1220/2752] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:46.446368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:46.446971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:46.453319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:46.453764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:46.454547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:46.454981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:46.581757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:46.589655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-12f1c639-d84d-42a4-937d-366d561a1eb5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147309 May 05 14:21:46.590246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1533/2753] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:46 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:47.408187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:47.408729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:47.415036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:47.415486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:47.416242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:47.416676 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:47.476153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:47.484219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-23602806-de6c-4007-85bf-f9b0b2e50cf7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080065 May 05 14:21:47.484770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1221/2754] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:47.607688 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:47.608315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:47.615222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:47.615680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:47.616437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:47.616875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:47.740991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:47.748664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8c6a628b-8bcc-4764-9fd8-535de2bca1d1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145087 May 05 14:21:47.749228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1534/2755] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:48.501377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:48.501938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:48.508515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:48.508971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:48.509741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:48.510241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:48.569366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:48.577128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa6598da-2b0c-4e98-b864-eb152f247be4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079710 May 05 14:21:48.577694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1222/2756] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:48.765858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:48.766434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:48.773265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:48.773717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:48.774523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:48.774969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:48.902538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:48.910943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83c95177-55ff-4320-9473-2d45d7f55787 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148984 May 05 14:21:48.911510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1535/2757] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:49.593727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:49.594383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:49.600393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:49.600834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:49.601586 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:49.602031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:49.662245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:49.669872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a6a56ae1-d041-45db-a693-fcb6bd24f114 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079995 May 05 14:21:49.670458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1223/2758] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:49.928702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:49.929233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:49.935590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:49.936037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:49.936789 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:49.937226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:50.081282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:50.089067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7c4af75c-0237-4025-8a87-34147c0e343d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.164928 May 05 14:21:50.089628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1536/2759] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:50.686770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:50.687359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:50.693917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:50.694512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:50.695267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:50.695700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:50.755528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:50.763226 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-643796a9-9ea4-4c1c-833c-7f60f1c63366 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080364 May 05 14:21:50.763787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1224/2760] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:50 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:21:51.107309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:51.107934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:51.114328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:51.114800 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:51.115544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:51.115981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:51.241878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:51.249679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-61b70a7c-735c-4087-847e-d24e9ef684b3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146464 May 05 14:21:51.250290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1537/2761] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:51.779834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:51.780457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:51.786935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:51.787388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:51.788153 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:51.788596 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:51.847704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:51.855469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2e2fb8b6-d3a6-4819-9c43-4ee71d2fddfc tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079528 May 05 14:21:51.856295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1225/2762] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:52.266976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:52.267615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:52.273981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:52.274466 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:52.275258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:52.275699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:52.402198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:52.410535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26220992-1e54-414b-89e4-0b08cfb74fc4 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147410 May 05 14:21:52.411103 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1538/2763] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:52.873056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:52.873675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:52.880668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:52.881117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:52.881884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:52.882352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:52.942193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:52.951235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92d0fd17-ef74-4dc6-9912-b216bd1d41dd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081121 May 05 14:21:52.951235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1226/2764] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:53.427648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:53.428271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:53.434665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:53.435129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:53.435895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:53.436339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:53.562823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:53.570828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-12113eba-8241-4d15-9722-845af78e86e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147091 May 05 14:21:53.571388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1539/2765] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:53 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:53.967086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:53.967693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:53.974040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:53.974496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:53.975247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:53.975680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:54.034764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:54.042493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ecbdab31-b23f-48e9-91b0-f3fd48aee289 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079255 May 05 14:21:54.043049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1227/2766] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:54.587555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:54.588172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:54.594644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:54.595089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:54.595844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:54.596277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:54.719134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:54.726946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf969233-b3b7-4ee5-985d-99bd83e5c3f5 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143269 May 05 14:21:54.727527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1540/2767] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:55.059885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:55.060408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:55.066856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:55.067315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:55.068093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:55.068535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:55.129245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:55.137088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f4724ae8-89c1-4a43-bc5c-71cb3fd38865 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081157 May 05 14:21:55.137662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1228/2768] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:55.744280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:55.744900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:55.751403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:55.751855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:55.752622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:55.753061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:55.879188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:55.887028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d8eaf427-352e-40b0-a663-f9725a00ac18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146660 May 05 14:21:55.887588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1541/2769] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:56.153681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:56.154317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:56.160696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:56.161146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:56.161907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:56.162371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:56.223245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:56.231362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b228e79a-d2cf-4e35-9786-e64038739dc2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081290 May 05 14:21:56.231930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1229/2770] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:56.904538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:56.905151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:56.912025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:56.912474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:56.913225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:56.913657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:57.041348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:57.049185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4307f552-4993-4cee-b09a-5a09620ed550 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148557 May 05 14:21:57.050686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1542/2771] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:57.248060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:57.248714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:57.255206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:57.255656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:57.256414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:57.256849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:57.317449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:57.325363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-70d61dd2-f76c-4ee6-a1fd-93582d4e08eb tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081251 May 05 14:21:57.328030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1230/2772] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:58.066313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:58.066960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:58.072916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:58.073365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:58.074159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:58.074597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:58.208702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:58.216350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dbb9d77b-bfad-40ae-92b6-b3e9a7c11f2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154104 May 05 14:21:58.216912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1543/2773] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:58.342316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:58.342971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:58.349297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:58.349761 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:58.350561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:58.351008 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:58.410945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:58.418729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-713f3a7f-8f85-470c-ae38-41c0fc60a1d4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080433 May 05 14:21:58.419296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1231/2774] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:59.233469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:59.234120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:59.240979 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:59.241423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:59.242199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:59.242637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:59.373687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:59.381960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3d9c465b-663f-4ec6-bba2-36457a5f2305 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.152575 May 05 14:21:59.382546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1544/2775] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:21:59.434690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:21:59.435303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:21:59.442283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:59.442741 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:59.443534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:21:59.443972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:21:59.505148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:21:59.512919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b5c03fd8-bbfb-4cb6-ae40-e1795861363a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082049 May 05 14:21:59.513492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1232/2776] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:21:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:00.398908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:00.399482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:00.405941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:00.406436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:00.407198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:00.408171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:00.529374 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:00.530135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:00.535863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:00.537362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:00.537909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:00.538775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:00.539281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:00.543679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0e5038d2-0987-47cd-9d7a-434ba6fa63fe tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148660 May 05 14:22:00.544256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1545/2777] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:00 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:00.602903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:00.611683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-87dd5ade-4b34-436d-bb1a-2d802f651915 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.086224 May 05 14:22:00.612253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1233/2778] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:01.561728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:01.562322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:01.568678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:01.569139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:01.569900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:01.570433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:01.628478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:01.629100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:01.635453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:01.635926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:01.636691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:01.637122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:01.703210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:01.711647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6f27a8b0-90f8-4f42-88ea-b16977424de2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087008 May 05 14:22:01.712233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1234/2779] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:01 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:01.719494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:01.727841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b84f198-9713-4502-89eb-279770513ca3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.170115 May 05 14:22:01.728395 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1546/2780] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:02.728720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:02.729350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:02.736066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:02.736518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:02.737284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:02.737726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:02.744461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:02.745070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:02.752017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:02.752476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:02.753839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:02.754320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:02.810163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:02.818540 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5dcebcb9-6f0b-4067-ae57-d1e75722aac6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093791 May 05 14:22:02.819108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1235/2781] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:02.890971 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:02.899551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-50555f58-4629-4a7c-b69c-866a922bb324 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158810 May 05 14:22:02.900127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1547/2782] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:03.834839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:03.835447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:03.841767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:03.842246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:03.843002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:03.843435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:03.902685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:03.910412 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0871f26b-f4e7-4de0-8e33-1ae663e30434 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079346 May 05 14:22:03.910984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1236/2783] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:03.916216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:03.916903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:03.923910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:03.924353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:03.925102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:03.925564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:04.062459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:04.071076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a342b060-7f4f-401e-856d-eb1feb0d92c2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.158613 May 05 14:22:04.071642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1548/2784] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:04.926627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:04.927262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:04.933710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:04.934221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:04.934995 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:04.935439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:04.995505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:05.003787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95eb02a2-91f2-49c9-923a-ed397322583e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081118 May 05 14:22:05.004352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1237/2785] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:05.088222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:05.088841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:05.095270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:05.095726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:05.096489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:05.096931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:05.221141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:05.228909 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-46a5dbcf-38cd-4293-87b8-0c844876ab04 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144526 May 05 14:22:05.229472 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1549/2786] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:05 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:06.021305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:06.021920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:06.028389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:06.028843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:06.029608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:06.030076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:06.093607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:06.101527 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0f3bbde8-7e2a-4dc4-a3cb-c41ed6933cd0 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084649 May 05 14:22:06.102117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1238/2787] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:06.246375 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:06.247025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:06.253902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:06.254384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:06.255178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:06.255616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:06.383300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:06.391199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-659509e4-a879-4810-b487-4d12600bf90d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148751 May 05 14:22:06.392266 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1550/2788] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:07.118992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:07.122410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:07.126696 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:07.127190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:07.127957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:07.128397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:07.189114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:07.196914 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83918a45-57d6-453a-8fd9-9e98326639e1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081826 May 05 14:22:07.197477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1239/2789] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:07.409173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:07.409795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:07.416198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:07.416651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:07.417415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:07.417858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:07.545602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:07.553887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-762ae1b0-8b11-4047-9cd4-141ff914d8cd tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149111 May 05 14:22:07.554556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1551/2790] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:07 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:08.214098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:08.214724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:08.221436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:08.221887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:08.222682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:08.223119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:08.282620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:08.290246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-681bf1a6-2b57-42a0-964b-f96f8c0ca03e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080021 May 05 14:22:08.290812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1240/2791] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:08.570566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:08.571153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:08.577496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:08.577950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:08.578746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:08.579187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:08.703566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:08.711571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-56bf01db-1c27-4f5a-89bf-b22bb9b5dd18 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144913 May 05 14:22:08.712143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1552/2792] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:08 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:09.307472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:09.308098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:09.314459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:09.314934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:09.315704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:09.316144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:09.380739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:09.388581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9532b2f0-6fe6-4739-8c04-6f278df9ab9b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085049 May 05 14:22:09.389149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1241/2793] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:09.728987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:09.729599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:09.736197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:09.736644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:09.737426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:09.737862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:09.861301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:09.869026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e8b09b4d-37a9-4742-942d-124b1255f75a tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143875 May 05 14:22:09.869581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1553/2794] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:10.405504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:10.406140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:10.412856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:10.413471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:10.414258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:10.414698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:10.474969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:10.483005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-12285707-8ac4-4848-a76c-9ea4ce3e8836 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081989 May 05 14:22:10.486834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1242/2795] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:10.886625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:10.887374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:10.894234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:10.894681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:10.895438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:10.895870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:11.022508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:11.030236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-64dfbf96-f379-4f81-afd7-3cd8b6d7498c tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147398 May 05 14:22:11.030804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1554/2796] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:10 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:11.499706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:11.500244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:11.506968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:11.507416 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:11.508322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:11.508882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:11.570874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:11.578896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4d7b96e7-0fcc-41c6-89dc-8e1f57dcc7d2 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083161 May 05 14:22:11.579988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1243/2797] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:12.047291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:12.048411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:12.054881 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:12.055340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:12.056104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:12.056546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:12.185595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:12.193985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-409452b2-4f03-4dd7-ad71-740440298b39 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150626 May 05 14:22:12.194612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1555/2798] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:12 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:12.596333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:12.596999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:12.603307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:12.603758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:12.604519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:12.604958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:12.668298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:12.676093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4882fe69-593e-422a-a262-6e838221eaed tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083571 May 05 14:22:12.676662 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1244/2799] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:13.211423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:13.211956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:13.218407 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:13.218888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:13.220193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:13.220643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:13.346665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:13.354502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1f624514-ba1a-4f6e-a1ea-ed3eb62e2eaa tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146917 May 05 14:22:13.355016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1556/2800] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:13.692837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:13.693380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:13.699744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:13.700200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:13.700961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:13.701403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:13.760878 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:13.769044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a7eaaedb-91d3-4578-ae54-1f02c79d8fa4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080200 May 05 14:22:13.769604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1245/2801] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:13 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:14.371962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:14.372512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:14.379520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:14.379965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:14.380720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:14.381152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:14.507665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:14.515437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bd4b3dc6-9aea-407c-a75c-8ceb039a873b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147448 May 05 14:22:14.516035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1557/2802] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:14 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:14.785521 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:14.786113 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:14.792466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:14.792920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:14.793685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:14.794152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:14.852850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:14.861451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d9317c0c-ba8a-4d33-852f-6bc5142b23e6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080385 May 05 14:22:14.862035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1246/2803] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:15.533027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:15.533577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:15.540168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:15.540622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:15.541394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:15.541836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:15.665257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:15.673647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1ff1b08f-b1c7-4836-b0e5-eb424b08b43f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144575 May 05 14:22:15.674243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1558/2804] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:15 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:15.877902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:15.878559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:15.884920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:15.885370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:15.886168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:15.886609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:15.950688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:15.959253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e2a776d1-4b55-4515-8cb0-9225c8743b30 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085173 May 05 14:22:15.961996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1247/2805] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:16.690765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:16.691384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:16.697728 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:16.698212 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:16.698995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:16.699433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:16.865063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:16.873036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f35d12ac-734c-45ce-a1af-51d179fe2540 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.186142 May 05 14:22:16.873606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1559/2806] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:16 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:17.094003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:17.094722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:17.100925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:17.101375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:17.102172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:17.102834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:17.163084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:17.170814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d020430-86dd-4d24-8bb5-b2a4bf4c051e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.198622 May 05 14:22:17.171370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1248/2807] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:17.890173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:17.890790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:17.897118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:17.897570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:17.898360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:17.898797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:18.026883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:18.035249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8cbcb801-823b-4a6b-9bf4-cecb2074d541 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148938 May 05 14:22:18.035811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1560/2808] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:18.187054 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:18.187580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:18.203038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:18.203513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:18.204783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:18.205216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:18.265096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:18.273275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c4dadb09-e2a8-4cf0-96ea-00d2635b0c38 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.090200 May 05 14:22:18.273837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1249/2809] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:18 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:19.052949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:19.053489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:19.059805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:19.060254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:19.061041 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:19.061478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:19.191465 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:19.199256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec074fe6-209a-4624-9d43-30d91aecb362 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150208 May 05 14:22:19.199826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1561/2810] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:19 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:19.290413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:19.291089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:19.297388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:19.298427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:19.299189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:19.299626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:19.367018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:19.374887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-566900bb-868d-4690-bd46-fb55a61ca286 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088286 May 05 14:22:19.375459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1250/2811] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:19 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:20.217484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:20.218128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:20.224559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:20.225008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:20.225770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:20.226236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:20.351245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:20.359282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7664a1c8-2024-47b8-859e-00852866c41b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145734 May 05 14:22:20.359785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1562/2812] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:20 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:20.391212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:20.391827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:20.397879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:20.398356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:20.399112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:20.399546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:20.458314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:20.465970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3433cbb9-fa80-48f6-9ba8-986fd3b47165 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078778 May 05 14:22:20.466556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1251/2813] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:20 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:21.376904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:21.377440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:21.384016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:21.384471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:21.385255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:21.385698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:21.482584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:21.483916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:21.490414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:21.490872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:21.491657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:21.492097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:21.556304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:21.565776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a4682e7f-da89-4eca-8eed-37a63e77526d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.087440 May 05 14:22:21.568404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1252/2814] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:21 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:21.695084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:21.702943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e36c6be3-fbc6-4af7-a6bb-49d020f49192 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.330159 May 05 14:22:21.703512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1563/2815] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:21 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:22.583443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:22.584097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:22.590541 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:22.590997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:22.591801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:22.592246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:22.651658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:22.659391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c684bae-68bf-436b-aeee-458b6b52aad9 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079756 May 05 14:22:22.659959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1253/2816] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:22 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:22.721011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:22.721628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:22.727904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:22.728352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:22.729110 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:22.729547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:22.855169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:22.863332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a429d9c9-cd35-4484-ac56-b69c6f2d193b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146720 May 05 14:22:22.863890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1564/2817] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:22 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:23.676121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:23.676738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:23.683080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:23.683525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:23.684279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:23.684714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:23.744215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:23.752528 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1764804e-3b91-4dcf-a840-66b1a62e8c43 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080337 May 05 14:22:23.753089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1254/2818] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:23 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:23.880381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:23.880994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:23.887556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:23.888016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:23.888784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:23.889230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:24.014245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:24.022569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d7703ec9-73fe-4caa-bbe4-33a9c727b39d tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146029 May 05 14:22:24.023134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1565/2819] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:23 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:24.769039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:24.769648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:24.776085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:24.776534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:24.777286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:24.777722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:24.836321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:24.843940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b62bdaf8-d57c-411c-b42b-86c77b06635e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079316 May 05 14:22:24.844496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1255/2820] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:24 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:25.040568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:25.041123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:25.048273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:25.048731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:25.049499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:25.049942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:25.177563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:25.185419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-692f3760-ddcf-446b-95c2-4b380f2b91cb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148989 May 05 14:22:25.185981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1566/2821] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:25 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:25.860019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:25.860632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:25.866990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:25.867435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:25.868217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:25.868650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:25.927871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:25.935560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2208e9a4-f2f6-403a-940f-ac3453dcbbc5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079675 May 05 14:22:25.936116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1256/2822] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:25 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:26.202541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:26.203146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:26.210227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:26.210692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:26.211468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:26.211917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:26.343955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:26.351748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bebbeab9-62d6-4c72-8c08-af5b11b51570 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.153138 May 05 14:22:26.352313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1567/2823] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:26 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:26.952628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:26.953274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:26.959715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:26.960167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:26.960929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:26.961369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:27.021452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:27.029284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ff9685ed-7c6d-44d0-9ece-670b720cabdf tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080503 May 05 14:22:27.029845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1257/2824] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:26 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:27.369718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:27.370369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:27.377277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:27.377747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:27.378567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:27.379037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:27.503884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:27.511671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dd5833b8-bd82-4ab7-8e3d-7e86f0922ec1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145819 May 05 14:22:27.512233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1568/2825] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:27 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:28.046590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:28.047203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:28.053999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:28.054472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:28.055230 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:28.055664 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:28.115383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:28.123279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-182b3709-bed5-4438-8cd9-854b0b37a136 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080524 May 05 14:22:28.123836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1258/2826] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:28 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:28.529359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:28.529970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:28.535896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:28.536344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:28.537097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:28.537536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:28.664632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:28.672819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6d673fb6-9bd1-4ed3-98b1-94640b903cea tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147036 May 05 14:22:28.673376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1569/2827] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:28 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:29.140531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:29.141771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:29.148163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:29.148617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:29.149382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:29.149825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:29.210543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:29.218297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-03b6f990-2617-4a0a-8e4f-cfd0829e5293 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081666 May 05 14:22:29.218863 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1259/2828] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:29 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:29.690382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:29.691035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:29.697292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:29.697754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:29.698550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:29.698995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:29.824984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:29.833440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-efcc50dd-e6bd-4742-8f2a-f1865f7c7c97 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147486 May 05 14:22:29.834007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1570/2829] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:29 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:30.235129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:30.235747 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:30.241998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:30.242473 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:30.243229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:30.243660 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:30.312151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:30.320617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ef72586-d1d5-4795-9109-a60819742c09 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.089556 May 05 14:22:30.321168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1260/2830] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:30 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:30.850611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:30.851231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:30.857850 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:30.858349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:30.859147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:30.859590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:30.983225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:30.991510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-43300eab-9faa-4099-8aba-bb739e6db8bc tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144812 May 05 14:22:30.992074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1571/2831] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:30 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:31.337243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:31.337862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:31.346085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:31.346535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:31.347293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:31.347730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:31.412818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:31.424992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5fbd64df-0cb8-4358-b2f7-7a7a08a30d8b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.091261 May 05 14:22:31.425723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1261/2832] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:31 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:32.008733 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:32.009360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:32.015750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:32.016861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:32.017615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:32.018074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:32.144639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:32.152434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-db1fbdd8-1440-4de8-b598-9c5adbf82d23 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147624 May 05 14:22:32.152994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1572/2833] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:32 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:32.442344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:32.442957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:32.449244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:32.449692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:32.450472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:32.450910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:32.509930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:32.517804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d622a11c-5566-48e8-b287-7e1ebd395dac tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079879 May 05 14:22:32.518402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1262/2834] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:32 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:33.169365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:33.169987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:33.176841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:33.177298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:33.178090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:33.178533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:33.306045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:33.313819 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4457cd65-6cf6-4f15-baab-3fab9dfe2de9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148353 May 05 14:22:33.314405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1573/2835] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:33 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:33.534423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:33.534974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:33.541239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:33.541686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:33.542480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:33.542909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:33.601967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:33.609926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-012056d5-3d31-48e9-b6e2-4531867ab274 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079507 May 05 14:22:33.610513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1263/2836] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:33 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:34.330739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:34.331361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:34.337722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:34.338275 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:34.339044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:34.339486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:34.462917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:34.470739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc250951-2e3a-437b-a483-2fd6cf03be69 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144593 May 05 14:22:34.471294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1574/2837] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:34 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:34.627232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:34.628361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:34.638188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:34.638652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:34.639435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:34.639881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:34.699689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:34.708200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7bae8d01-3e88-4b61-9f86-e9cae62671d7 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.085684 May 05 14:22:34.708769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1264/2838] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:34 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:35.488371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:35.488901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:35.495439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:35.495895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:35.496695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:35.497136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:35.627287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:35.635187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9e93d378-4700-4f60-865d-e30d2fb8691e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151263 May 05 14:22:35.635685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1575/2839] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:35 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:35.724228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:35.724870 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:35.731277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:35.731986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:35.732749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:35.733192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:35.792728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:35.800529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8968a97d-b833-4692-95d1-fc43ae0ae18f tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080105 May 05 14:22:35.801103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1265/2840] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:35 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:36.652865 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:36.653772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:36.660414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:36.661156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:36.662451 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:36.663162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:36.802578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:36.810385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a03b990e-8424-4eb2-bcfd-dcc66ef98164 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.161386 May 05 14:22:36.810944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1576/2841] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:36 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:36.816679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:36.817337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:36.823701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:36.824163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:36.824935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:36.825381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:36.885142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:36.893410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-67c9a19a-bf33-4865-ab8c-0b623705b5ec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080632 May 05 14:22:36.893969 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1266/2842] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:36 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:37.827330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:37.827951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:37.834830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:37.835294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:37.836083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:37.836528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:37.910582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:37.911202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:37.918243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:37.918691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:37.919458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:37.919895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:37.972692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:37.980596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-08d442fe-8960-4bc2-b175-2a29a15e23f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.157182 May 05 14:22:37.981171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1577/2843] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:37 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:37.988148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:37.995909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-97f15671-be2e-47f8-93bb-321da0823f17 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.089278 May 05 14:22:37.996462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1267/2844] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:37 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:38.997972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:38.998628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:39.005538 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:39.005999 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:39.006851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:39.007457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:39.012491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:39.013206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:39.020173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:39.020627 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:39.021397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:39.021839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:39.104955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:39.113515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3fb12da9-59b4-45f4-94a2-6292db56a55d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.104828 May 05 14:22:39.114105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1268/2845] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:39 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:39.160131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:39.167812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e861edc0-e3e3-4cc1-b23a-0e7374c84805 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.173762 May 05 14:22:39.168367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1578/2846] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:38 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:40.130681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:40.131296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:40.137567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:40.138029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:40.138792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:40.139225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:40.184536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:40.185148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:40.191922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:40.192374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:40.193133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:40.193597 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:40.207168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:40.215177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-95a87896-9f2d-4e6c-a00b-6da0966b3408 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.088214 May 05 14:22:40.216452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1269/2847] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:40 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:40.358527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:40.366480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-327ca9a1-f19c-4daf-9717-e50992681495 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.185674 May 05 14:22:40.367056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1579/2848] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:40 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:41.233407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:41.234041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:41.241244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:41.241698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:41.242494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:41.242934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:41.303779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:41.311835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c3b5d1c1-3b31-4b2c-b705-cd97f1c62c9a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082479 May 05 14:22:41.312398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1270/2849] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:41 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:41.383520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:41.384137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:41.390350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:41.390801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:41.391561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:41.391998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:41.515357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:41.523642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf7f4993-d138-496f-b8fc-07d82d5be2e9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.143954 May 05 14:22:41.524207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1580/2850] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:41 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:42.329292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:42.329908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:42.336269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:42.336721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:42.337479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:42.337917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:42.400818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:42.409220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-58321d56-2a07-47e0-b69d-0c271a857c94 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083783 May 05 14:22:42.409791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1271/2851] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:42 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:42.548648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:42.549306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:42.555667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:42.556122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:42.556919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:42.557363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:42.683566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:42.691742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-accd4cdf-8cd3-4ce2-8785-40c7d28281b1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147527 May 05 14:22:42.694140 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1581/2852] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:42 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:43.425511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:43.426100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:43.432573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:43.433024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:43.433784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:43.434251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:43.493385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:43.501809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6375bd94-d068-41f8-aa77-ec959ca62d05 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080208 May 05 14:22:43.502461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1272/2853] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:43 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:43.708172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:43.708726 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:43.715125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:43.715587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:43.716358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:43.716804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:43.845178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:43.852943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-42de34b6-69ba-46d1-820c-1a5ef3f17e80 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148761 May 05 14:22:43.853509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1582/2854] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:43 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:44.519136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:44.519702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:44.526101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:44.526553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:44.527307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:44.527745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:44.599930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:44.608179 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b551fa67-2966-4cca-9c0e-16998a9f3f45 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.093501 May 05 14:22:44.608769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1273/2855] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:44 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:44.870735 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:44.871351 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:44.878180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:44.878633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:44.879388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:44.879822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:45.009009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:45.017324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b018b62-902e-4cab-bd9b-257a5eb8fdc8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150424 May 05 14:22:45.017918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1583/2856] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:44 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:45.624766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:45.625382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:45.631811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:45.632262 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:45.633014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:45.633448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:45.695023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:45.702682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fd934377-0f64-42ea-b050-ebaa08762de5 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081843 May 05 14:22:45.703336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1274/2857] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:45 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:46.035596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:46.036339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:46.042820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:46.043280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:46.044048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:46.044494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:46.169468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:46.178220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e8d78db1-f7cf-4c80-acdf-f52afeb9f743 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147257 May 05 14:22:46.178814 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1584/2858] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:46 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:46.718545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:46.719146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:46.726089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:46.726536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:46.727293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:46.727726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:46.787718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:46.795424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5076e171-e32d-4c40-b855-3cd6388e0f5c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080757 May 05 14:22:46.795984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1275/2859] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:46 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:47.196037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:47.196651 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:47.203019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:47.203469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:47.204829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:47.205264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:47.331493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:47.339371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-293542af-0651-4d54-a62b-19fc88b3d4cf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147302 May 05 14:22:47.339927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1585/2860] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:47 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:47.812079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:47.812692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:47.819526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:47.819975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:47.820727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:47.821161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:47.882085 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:47.889716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a5da075d-5609-4768-8e53-738d0f29a4cd tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081486 May 05 14:22:47.890319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1276/2861] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:47 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:48.356960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:48.357523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:48.363862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:48.364315 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:48.365082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:48.365525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:48.487643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:48.495464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5b75b5e2-c334-4edd-baf7-e8a4286717c8 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.142809 May 05 14:22:48.496032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1586/2862] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:48 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:48.906899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:48.907514 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:48.913746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:48.914238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:48.914998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:48.915433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:48.978419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:48.986932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-323dcffa-0c72-4aa0-bf98-192396480930 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083914 May 05 14:22:48.987523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1277/2863] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:48 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:49.513221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:49.513770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:49.520764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:49.521211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:49.521963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:49.522448 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:49.646129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:49.653840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-855c5848-95ce-4117-953a-4337734189fb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144715 May 05 14:22:49.654428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1587/2864] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:49 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:50.004274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:50.004934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:50.010888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:50.011343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:50.012134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:50.012574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:50.071407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:50.079758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-64a23b0a-97f8-4e17-983d-fd9ae7a0f64e tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079592 May 05 14:22:50.080332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1278/2865] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:49 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:50.670832 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:50.671428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:50.677738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:50.678223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:50.678980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:50.679417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:50.805922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:50.814220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa0d19c5-d759-4bcd-a739-c53868f4b391 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147217 May 05 14:22:50.814772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1588/2866] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:50 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:51.095830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:51.096448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:51.102941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:51.103266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:51.104053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:51.104489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:51.163673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:51.171316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dd67cbfe-497d-481b-93b6-cb5115dc007d tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079353 May 05 14:22:51.171875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1279/2867] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:51 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:51.831492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:51.832089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:51.838418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:51.838886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:51.839640 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:51.840077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:51.964388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:51.972311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-011f1065-82cb-42de-994f-50803348c12f tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144772 May 05 14:22:51.972882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1589/2868] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:51 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:52.188381 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:52.189003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:52.195478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:52.195930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:52.196692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:52.197136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:52.259727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:52.268173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b8ce40f8-d478-4b96-9eff-180838a5b481 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083673 May 05 14:22:52.268748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1280/2869] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:52 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:52.989950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:52.990593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:52.997152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:52.997612 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:52.998414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:52.998859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:53.125109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:53.133715 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d5a89139-a74a-466c-a6c3-7f1809e2f93b tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147613 May 05 14:22:53.134319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1590/2870] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:52 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:53.284745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:53.285307 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:53.291776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:53.292234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:53.293005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:53.293451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:53.352699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:53.361236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-989ed86a-3ccf-4da6-b030-943f0b23a8d6 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080441 May 05 14:22:53.361807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1281/2871] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:53 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:54.151329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:54.151939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:54.158998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:54.159449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:54.160209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:54.160645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:54.286460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:54.294158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b4226bec-71c6-4c22-a1ef-37ee01732da1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146687 May 05 14:22:54.294711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1591/2872] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:54 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:54.377873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:54.378456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:54.384859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:54.385312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:54.386101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:54.386543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:54.444937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:54.452520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7419ac08-fd26-4e9f-b2c1-be477ef64ed4 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079047 May 05 14:22:54.453091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1282/2873] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:54 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:55.310753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:55.311377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:55.317734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:55.318232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:55.319007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:55.319452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:55.443933 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:55.451729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8da8fa5d-8c15-4d11-98a1-26b378808a68 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144913 May 05 14:22:55.452293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1592/2874] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:55 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:55.469657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:55.470308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:55.477220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:55.477673 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:55.478496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:55.478934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:55.541041 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:55.550003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-be2313e2-a49b-482f-83e8-8b48233a97a1 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.084161 May 05 14:22:55.550715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1283/2875] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:55 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:56.468837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:56.469962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:56.476373 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:56.476827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:56.477590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:56.478037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:56.566797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:56.567457 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:56.573848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:56.574347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:56.575125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:56.575570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:56.605428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:56.613570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-954d7b43-e863-4c1b-9901-b4fde5f6ab29 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.148712 May 05 14:22:56.614165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1593/2876] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:56 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:56.636158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:56.644579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9ed16453-45d7-49aa-9542-5b440a57153a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081640 May 05 14:22:56.645139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1284/2877] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:56 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:57.631122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:57.631739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:57.638128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:57.638580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:57.639341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:57.639779 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:57.660780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:57.661396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:57.667410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:57.667853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:57.668612 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:57.669046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:57.751665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:57.759410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c585f19-09d1-42ed-b013-97e0301c9d3c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.102396 May 05 14:22:57.759973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1285/2878] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:57 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:57.786334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:57.794057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6a52fdc5-85f2-413d-8a26-7a02b311744e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.166807 May 05 14:22:57.794611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1594/2879] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:57 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:58.776333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:58.776960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:58.783868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:58.784314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:58.785064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:58.785501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:58.811568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:58.812189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:58.818232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:58.818684 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:58.819449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:58.819886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:58.846939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:58.855474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7578a32c-2052-4d30-a159-6f76fb6232b8 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082951 May 05 14:22:58.856055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1286/2880] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:58 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:58.949482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:58.957748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3bc12ad1-e687-4584-8d14-dc86a30e55b7 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150144 May 05 14:22:58.958341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1595/2881] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:58 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:22:59.874170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:59.874780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:59.881160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:59.881607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:59.882402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:59.882860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:59.942101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:22:59.949801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-97801544-cc9b-4d8a-83cb-d865a5cc106a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079563 May 05 14:22:59.950395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1287/2882] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:59 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:22:59.975123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:22:59.975743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:22:59.982318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:59.982776 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:22:59.983544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:22:59.983994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:00.108376 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:00.116208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c8ecdf85-db6d-4d7f-9240-80d10f681757 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144872 May 05 14:23:00.116769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1596/2883] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:22:59 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:00.966094 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:00.966691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:00.973561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:00.974005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:00.974792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:00.975225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:01.034425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:01.042035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-552bdf47-17a5-4904-86c0-f66071b4158b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079884 May 05 14:23:01.042600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1288/2884] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:00 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:01.132548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:01.133197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:01.139606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:01.140068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:01.140840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:01.141919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:01.267649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:01.275438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9f857755-04ac-4d4e-a302-f1bbb5c56fe1 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146725 May 05 14:23:01.276002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1597/2885] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:01 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:02.058801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:02.059415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:02.065765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:02.066248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:02.067010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:02.067444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:02.127107 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:02.135119 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5e4c1e36-0d0d-4208-8094-6a31e0e3daec tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080184 May 05 14:23:02.135695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1289/2886] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:02 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:02.292605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:02.293261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:02.299660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:02.300145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:02.300921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:02.301369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:02.434508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:02.442753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b1f361c5-188d-4c62-91ac-16a206955713 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.154051 May 05 14:23:02.443316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1598/2887] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:02 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:03.151903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:03.152531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:03.158933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:03.159390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:03.160158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:03.160602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:03.220675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:03.228503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-113a8b1f-f5c9-4e1f-9bc5-ccf8c4901269 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080444 May 05 14:23:03.229069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1290/2888] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:03 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:23:03.459568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:03.460115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:03.466433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:03.466886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:03.467643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:03.468081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:03.591534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:03.599853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-62920a35-8ced-4b7b-8375-08c11fc481f2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.144210 May 05 14:23:03.600420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1599/2889] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:03 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:04.245803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:04.246449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:04.252798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:04.253251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:04.254027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:04.254478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:04.313837 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:04.321454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e4ce84dd-0b67-42ae-8b59-fdb1240a5c20 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079538 May 05 14:23:04.322023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1291/2890] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:04 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:04.616585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:04.617247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:04.623637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:04.624093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:04.624861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:04.625947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:04.751158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:04.759112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cf6c1104-0817-4274-a031-67847d59aa2e tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.146300 May 05 14:23:04.759697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1600/2891] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:04 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:05.337956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:05.338743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:05.345704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:05.346203 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:05.346967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:05.347403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:05.406053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:05.414638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4190911c-0278-422c-bfc0-f60d45f95221 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081247 May 05 14:23:05.415215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1292/2892] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:05 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:05.777137 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:05.777662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:05.784219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:05.784669 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:05.785431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:05.785871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:05.914703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:05.923512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dd55c876-3867-452b-93f0-b7422ebfe2ac tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.150200 May 05 14:23:05.924059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1601/2893] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:05 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:06.430823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:06.431384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:06.438299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:06.438754 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:06.439523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:06.439965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:06.501155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:06.508973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3fbe1772-e79e-493f-83db-894b0bb42b5a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.082150 May 05 14:23:06.509543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1293/2894] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:06 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:06.941302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:06.941921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:06.948590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:06.949129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:06.949902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:06.950575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:07.074323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:07.082133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3e997d7e-0af3-4dc4-92a9-ccb512dd8e75 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145476 May 05 14:23:07.082692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1602/2895] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:06 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:07.525639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:07.526275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:07.533224 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:07.533678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:07.534480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:07.534923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:07.602785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:07.611784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4cb71bd4-b719-4959-aabe-0a39c88bb3a3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.090165 May 05 14:23:07.615525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1294/2896] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:07 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:08.099810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:08.100428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:08.107128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:08.107588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:08.108357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:08.108805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:08.250860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:08.258645 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2889a70b-539f-4476-8899-87c4ccad88b6 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.162712 May 05 14:23:08.259211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1603/2897] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:08 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:08.628699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:08.629314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:08.635653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:08.636100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:08.636856 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:08.637290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:08.697520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:08.706093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-08772aed-25cc-456d-8b52-ee23232cb9f3 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081706 May 05 14:23:08.706668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1295/2898] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:08 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:09.276183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:09.276806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:09.283755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:09.284210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:09.284974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:09.285416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:09.410299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:09.418097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5fbf75f1-3f87-4290-bf58-4ca36b5defdf tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145775 May 05 14:23:09.418660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1604/2899] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:09 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:09.721561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:09.722202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:09.728532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:09.728978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:09.729731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:09.730200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:09.788564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:09.796236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b44c06e9-c54b-4a22-877a-334a9932667a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.078369 May 05 14:23:09.796800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1296/2900] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:09 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:10.434422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:10.435045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:10.441495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:10.441950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:10.442737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:10.443178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:10.567845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:10.575695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eeabb2f1-eda6-4b58-aaad-2ef11b7e5932 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145153 May 05 14:23:10.576256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1605/2901] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:10 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:10.812712 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:10.813285 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:10.819713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:10.820172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:10.820940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:10.821383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:10.880939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:10.888619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b38ed360-ddf1-4cb4-beee-8f143d40c525 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079849 May 05 14:23:10.889193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1297/2902] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:10 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:11.592729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:11.593345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:11.600404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:11.600858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:11.601621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:11.602089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:11.729361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:11.737993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f47a2e30-6ec7-4f97-ace2-e05aa2d124d3 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149213 May 05 14:23:11.738582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1606/2903] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:11 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:11.905339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:11.905990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:11.912867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:11.913315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:11.914106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:11.914550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:11.974200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:11.982292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0e85a8ba-2277-4b3e-a21c-b38c577ed45c tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.080537 May 05 14:23:11.982854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1298/2904] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:11 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:12.755258 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:12.755883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:12.762209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:12.762671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:12.763443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:12.763887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:12.895454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:12.903322 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-52fd1d03-67ef-4832-9ff8-de20951f2a58 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.151817 May 05 14:23:12.903825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1607/2905] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:12 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:12.999548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:13.000818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:13.007219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:13.007675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:13.008444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:13.008917 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:13.316304 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:13.324182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-02a2cfd7-4723-488d-bbaa-59b264ba479b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.328543 May 05 14:23:13.324749 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1299/2906] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:12 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:13.921111 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:13.921866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:13.928366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:13.928820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:13.929582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:13.930078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:14.058302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:14.066549 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef68534c-9c36-4972-9a40-0c6d36d252f9 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.149814 May 05 14:23:14.067097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1608/2907] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:13 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:23:14.340495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:14.341121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:14.347520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:14.347972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:14.348743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:14.349186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:14.410886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:14.420137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f184215c-5ccd-4619-bb16-2afc953bf49b tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.083578 May 05 14:23:14.420727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1300/2908] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:14 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:15.084332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:15.084952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:15.091357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:15.091817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:15.092585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:15.093065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:15.220533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:15.228291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5d748ccb-ffb3-4272-b442-624975ce6bbb tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.147824 May 05 14:23:15.228857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1609/2909] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:15 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:15.436530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:15.437064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:15.443420 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:15.443865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:15.444621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:15.445051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:15.504425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:15.512655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e8ecc629-e7b9-463b-bd2d-d66af58cc508 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.079872 May 05 14:23:15.513249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1301/2910] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:15 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:16.245565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:16.246221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:16.252625 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:16.253081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:16.253837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:16.254308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:16.379767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:16.387556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c42b7ea4-687c-4050-945a-7a4f17e80bf2 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145874 May 05 14:23:16.388118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1610/2911] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:16 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:16.531106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:16.532373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] [instance: 11a3b3a4-b7f6-4697-a2b4-11913492a055] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:16.538971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:16.539427 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:16.540228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:16.540667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:16.601011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a07bae627665426fba032d7757685fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c9372df138414191186d3c950d2e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:16.609125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b6fbc0c8-9014-4ed3-9791-3691a5f9f037 tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055" status: 200 len: 1390 microversion: 2.1 time: 0.081763 May 05 14:23:16.609689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1302/2912] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:16 2022] GET /compute/v2.1/servers/11a3b3a4-b7f6-4697-a2b4-11913492a055 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:16.624761 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7dfb0ca5-9af3-4115-b412-345831d6a55a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] Calling method '.version_select at 0x7fb4e2f1f670>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:16.700200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7dfb0ca5-9af3-4115-b412-345831d6a55a tempest-TestMinimumBasicScenario-233818003 tempest-TestMinimumBasicScenario-233818003-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820779916" status: 202 len: 0 microversion: 2.1 time: 0.079149 May 05 14:23:16.700691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1611/2913] 10.222.0.26 () {58 vars in 1271 bytes} [Thu May 5 14:23:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1820779916 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:23:17.404827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:17.405447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] [instance: e2d5d14e-9371-4d0f-8b25-22c081bab3d9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:17.411503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:17.411953 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:17.412721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:17.413160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:17.538249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf7c7226e1747f397783c8d4429f601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc26737fc8c745fa952abfd840bf9278', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:17.546717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ce970793-8527-4bd4-94d1-0cf0732d9b81 tempest-VolumesSnapshotTestJSON-1542657248 tempest-VolumesSnapshotTestJSON-1542657248-project] 10.222.0.26 "GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9" status: 200 len: 1561 microversion: 2.1 time: 0.145729 May 05 14:23:17.547276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1303/2914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:17 2022] GET /compute/v2.1/servers/e2d5d14e-9371-4d0f-8b25-22c081bab3d9 => generated 1561 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:18.680372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:18.681014 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:18.687295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:18.689254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:18.689254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:18.689254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:18.721455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:23:18.968105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2baaa414-016b-423f-ba93-2c540248451f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 204 len: 0 microversion: 2.1 time: 0.291833 May 05 14:23:18.969489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1612/2915] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:23:18 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:23:18.977905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:18.979160 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:18.986180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:18.986637 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:18.987398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:18.987834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:19.187011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:19.194840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6dae2a68-45b5-4cfc-a26a-00e9016c716d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.220881 May 05 14:23:19.195405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1304/2916] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:20.213450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:20.214211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:20.221348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:20.221794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:20.222835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:20.223283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:20.425349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:20.437858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-25e98fd6-0ef2-4296-89a5-86c1e36d0a45 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.227976 May 05 14:23:20.438662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1613/2917] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:21.455358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:21.456702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:21.463622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:21.464390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:21.466127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:21.467410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:21.617266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:21.626389 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0024fa49-f21b-4536-b17b-293911c8175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.174928 May 05 14:23:21.626963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1305/2918] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:22.644644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:22.645188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:22.651833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:22.652295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:22.653075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:22.653524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:22.872905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:22.881269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-58f00bf9-4f55-47d4-90c5-9f33b4e4b32c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.241236 May 05 14:23:22.881848 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1614/2919] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:23.899581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:23.900196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:23.906784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:23.907326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:23.915422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:23.915885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:24.125841 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:24.134901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4592e8ea-e19f-4e17-902f-3ca51c83d7f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.239605 May 05 14:23:24.135486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1306/2920] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:23:25.154736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:25.155354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:25.162553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:25.163006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:25.163782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:25.164223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:25.303429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:25.311536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9391f3ac-c216-449f-b76b-2b96cd5c7ee6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.160663 May 05 14:23:25.312143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1615/2921] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:26.330680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:26.331352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:26.338592 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:26.339141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:26.339979 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:26.340483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:26.467830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:26.475844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b199a3a7-1fcb-4145-a218-6d9ffd8e81bd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150975 May 05 14:23:26.476405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1307/2922] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:27.493059 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:27.493690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:27.501581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:27.502070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:27.502931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:27.503379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:27.642998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:27.651499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-18a9325e-792d-4318-b126-85980174e696 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.162583 May 05 14:23:27.652185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1616/2923] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:28.668209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:28.668823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:28.675268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:28.675710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:28.676467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:28.676902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:28.800089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:28.807882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-31f57a2d-ebc8-4b4b-b4cb-84cdb00221f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143546 May 05 14:23:28.808449 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1308/2924] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:29.825606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:29.826312 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:29.832956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:29.833411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:29.834249 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:29.834694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:29.958751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:29.966614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-11dabc8b-37b5-403d-bcf2-fb076d9eb7e5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144883 May 05 14:23:29.967176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1617/2925] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:30.984804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:30.985518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:30.991889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:30.992333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:30.993091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:30.993523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:31.120161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:31.128428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c7b27f1-e8e9-44b6-9931-7308d9483cd6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148378 May 05 14:23:31.129002 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1309/2926] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:32.145560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:32.146219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:32.152657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:32.153115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:32.153891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:32.154371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:32.280329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:32.288662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-126c16b7-d049-4f81-ba92-507d3afd5857 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147016 May 05 14:23:32.289218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1618/2927] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:33.306204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:33.306814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:33.313124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:33.313570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:33.314351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:33.314786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:33.467628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:33.476089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a1974f3d-34e1-4219-8d02-739128158cf0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.173767 May 05 14:23:33.476657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1310/2928] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:34.496503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:34.497037 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:34.504173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:34.504633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:34.505399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:34.505838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:34.633255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:34.640996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-52e19ae2-d412-4edc-8358-7811f7c98235 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148487 May 05 14:23:34.641561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1619/2929] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:35.658210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:35.658763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:35.665122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:35.665570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:35.666363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:35.666803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:35.796187 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:35.803920 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b065c83d-4edc-4166-8fab-236865444f03 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149703 May 05 14:23:35.804483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1311/2930] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:36.821332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:36.821987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:36.828998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:36.829437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:36.830235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:36.830679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:36.952467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:36.960943 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ac70764b-47fd-4818-b01c-649483160946 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143499 May 05 14:23:36.961502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1620/2931] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:37.978525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:37.979065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:37.986297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:37.986753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:37.987522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:37.987963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:38.117510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:38.125859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0d872036-4149-41df-8506-d9e407e0fcc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151368 May 05 14:23:38.126443 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1312/2932] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:39.143658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:39.144283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:39.150729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:39.151193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:39.151965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:39.152412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:39.282261 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:39.290048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-919852c1-fd84-4287-a48f-a2b6d3f7969e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150850 May 05 14:23:39.290614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1621/2933] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:40.307032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:40.307650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:40.314083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:40.314537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:40.315301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:40.315742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:40.441341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:40.449124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d76c967a-d9a2-42f1-bd72-497276bdce21 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145933 May 05 14:23:40.449678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1313/2934] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:41.466843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:41.467410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:41.473691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:41.474185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:41.474945 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:41.475388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:41.602719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:41.610774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-625b66e9-3f3a-4e1b-83de-b08029a833ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147958 May 05 14:23:41.611363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1622/2935] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:42.628103 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:42.628635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:42.634869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:42.635315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:42.636072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:42.636507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:42.772247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:42.779909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9197b4d8-46fc-469d-8fcc-adde6077ebcd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155886 May 05 14:23:42.781053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1314/2936] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:43.797603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:43.798295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:43.804618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:43.805071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:43.805863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:43.806335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:43.933691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:43.942236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d183fe50-665e-436a-a729-4d90c90bb9f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148438 May 05 14:23:43.942801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1623/2937] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:44.959393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:44.960074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:44.966549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:44.967010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:44.967778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:44.968839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:45.090922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:45.098757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4068bacb-0cd4-47bb-9a43-05e504a162f2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143194 May 05 14:23:45.099329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1315/2938] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:46.116148 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:46.116768 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:46.123155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:46.123614 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:46.124940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:46.125379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:46.249749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:46.258151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0309a68c-77e4-4590-a50b-111f4a2e2ec6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145722 May 05 14:23:46.258729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1624/2939] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:47.275900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:47.276515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:47.283474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:47.283925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:47.284692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:47.285130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:47.412368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:47.420279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0054c5e2-dd3e-43a1-ae7b-b2f969525c09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148234 May 05 14:23:47.420836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1316/2940] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:48.437982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:48.438571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:48.444904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:48.445353 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:48.446136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:48.446575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:48.577276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:48.585115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-366a7bec-9d33-48b4-ba86-237920f11e34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151678 May 05 14:23:48.585676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1625/2941] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:49.602764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:49.603376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:49.610211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:49.610666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:49.611430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:49.611873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:49.739445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:49.747169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f9ddcb50-debe-4920-b2e3-19f4d78a71e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148353 May 05 14:23:49.747738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1317/2942] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:50.764968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:50.765630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:50.772050 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:50.772506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:50.773278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:50.773718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:50.896812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:50.904577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-79404cce-8568-4785-b905-10bbf4cf04ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143567 May 05 14:23:50.905141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1626/2943] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:51.921582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:51.922221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:51.928593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:51.929036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:51.929787 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:51.930252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:52.055065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:52.063326 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a24c36f3-0ece-4aa7-911f-d6fbe0063ce1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145614 May 05 14:23:52.063887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1318/2944] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:53.080422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:53.081044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:53.087533 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:53.087990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:53.088758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:53.089200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:53.475409 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:53.483430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7ce985cb-2a91-494b-8fa7-5e3c0e82d1be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.407491 May 05 14:23:53.483996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1627/2945] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:54.500734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:54.501292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:54.507608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:54.508060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:54.508822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:54.509263 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:54.643807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:54.651565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-17186544-0f35-4394-b496-5185c1c87f25 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154879 May 05 14:23:54.652123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1319/2946] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:55.669330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:55.669961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:55.676516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:55.676975 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:55.677754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:55.678242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:55.805993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:55.814284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e223168b-b33c-4bd5-9320-86ee97e7ae66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148874 May 05 14:23:55.814854 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1628/2947] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:56.831753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:56.832363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:56.838703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:56.839151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:56.839903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:56.840336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:56.964799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:56.973549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e6291a55-bdd8-47be-9e7f-f8b69788d17d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145620 May 05 14:23:56.974133 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1320/2948] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:57.991736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:57.992333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:57.998757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:57.999227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:57.999996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:58.000440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:58.129281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:58.137089 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f5268cb-7353-4d42-9de9-7b67e73a295c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149262 May 05 14:23:58.137657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1629/2949] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:23:59.154950 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:23:59.156168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:23:59.162581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:59.163031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:59.163793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:23:59.164229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:23:59.287322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:23:59.295124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26bcf107-03cd-4e33-8134-69e3dcc65a4a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144028 May 05 14:23:59.295693 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1321/2950] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:23:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:00.312385 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:00.313007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:00.319369 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:00.319821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:00.320582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:00.321023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:00.446340 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:00.454654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1bd394e7-86b9-40da-9238-9965158b8176 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146142 May 05 14:24:00.455221 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1630/2951] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:01.471268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:01.471804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:01.478167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:01.478619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:01.479371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:01.479809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:01.609518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:01.617283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1e49d00d-3ec1-43b5-a5de-897bd43292bc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149931 May 05 14:24:01.617855 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1322/2952] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:02.634393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:02.635144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:02.642028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:02.642493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:02.643262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:02.643702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:02.769060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:02.776801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5a3841f6-4d55-4f8f-a0b3-5bddf09b0c78 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146308 May 05 14:24:02.777360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1631/2953] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:03.794102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:03.794743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:03.801065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:03.801507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:03.802282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:03.802715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:03.929798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:03.937567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-68577145-2c22-4a3c-800a-6b5feeddaa8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147320 May 05 14:24:03.938149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1323/2954] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:04.955210 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:04.955828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:04.962204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:04.962659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:04.963423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:04.963864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:05.086309 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:05.094198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c86e5b2e-395f-47b1-b660-a7cc7012d8ac tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143492 May 05 14:24:05.094767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1632/2955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:06.112069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:06.112694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:06.119241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:06.119697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:06.120497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:06.120939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:06.250155 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:06.257859 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-065ea6df-fa20-4318-ac7d-1d16ad45ba0d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149707 May 05 14:24:06.258463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1324/2956] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:07.276169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:07.276792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:07.283264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:07.283741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:07.284496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:07.284944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:07.412067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:07.419860 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f241a0a5-5501-41df-a322-b7d0388773ca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147602 May 05 14:24:07.420424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1633/2957] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:08.436816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:08.437373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:08.443756 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:08.444210 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:08.444977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:08.445414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:08.568520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:08.576242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a152489-df5f-442f-88b0-4762a62dca14 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143444 May 05 14:24:08.576807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1325/2958] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:09.592853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:09.593505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:09.599873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:09.600325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:09.601094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:09.601535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:09.730424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:09.738555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-de1d9d68-b8b6-48a2-9e7a-8160443d5ba9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149564 May 05 14:24:09.739119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1634/2959] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:10.755633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:10.756314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:10.762710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:10.763162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:10.763926 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:10.764365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:10.889131 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:10.896932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2b9db2ba-00b7-4798-8a7e-604651fde6ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145262 May 05 14:24:10.897488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1326/2960] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:11.914995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:11.915570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:11.921878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:11.922366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:11.923130 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:11.923570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:12.051386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:12.059144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e298a882-6ef0-4ecd-9b19-b3af60c8757d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148149 May 05 14:24:12.059747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1635/2961] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:13.076483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:13.077651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:13.084117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:13.084570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:13.085334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:13.085773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:13.210665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:13.218404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c7a7623c-20da-4d76-99c7-30b82b42d4cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145723 May 05 14:24:13.218976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1327/2962] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:14.236636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:14.237254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:14.243736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:14.244195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:14.244955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:14.245399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:14.371928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:14.379801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb63a8fa-9895-41bd-87bb-31311a3b4f84 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147957 May 05 14:24:14.380368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1636/2963] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:15.397158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:15.397745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:15.404267 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:15.404720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:15.406032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:15.406481 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:15.531752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:15.539499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-90ae0d76-062b-4899-a489-194557ab7725 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146374 May 05 14:24:15.540062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1328/2964] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:16.557479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:16.558075 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:16.564467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:16.564961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:16.565731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:16.566236 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:16.691821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:16.699904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bfbbc7b5-3c62-409b-bbe4-b0b5e3734088 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146363 May 05 14:24:16.700495 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1637/2965] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:17.717551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:17.718687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:17.725073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:17.725530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:17.726323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:17.726766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:17.855638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:17.864417 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-21de2407-cab3-4b2d-a08d-e21c46b5ee4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150670 May 05 14:24:17.864941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1329/2966] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:18.881456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:18.882163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:18.888519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:18.888972 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:18.889820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:18.890289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:19.016486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:19.024317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0ee32fb7-9257-40e5-87b8-4c09352f7b81 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146734 May 05 14:24:19.024877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1638/2967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:20.042178 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:20.042805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:20.048809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:20.049265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:20.050048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:20.050523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:20.180044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:20.188271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e9eb7b7e-c5cb-41be-bb71-20dbe9b8c544 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150148 May 05 14:24:20.188828 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1330/2968] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:21.204710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:21.205333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:21.211740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:21.212196 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:21.212960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:21.213403 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:21.340160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:21.347978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-831ca7fb-4fd7-4724-b1cd-929708a30fba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147110 May 05 14:24:21.348550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1639/2969] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:22.365564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:22.366125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:22.372492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:22.372941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:22.373698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:22.374173 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:22.497186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:22.504860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-633f085e-f441-4809-b1dd-e064293c3a30 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143239 May 05 14:24:22.505421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1331/2970] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:23.522102 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:23.522654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:23.529009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:23.529458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:23.530247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:23.530682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:23.660822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:23.668526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-76e911e5-70e1-496a-bbbf-8c3c36becded tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150355 May 05 14:24:23.669181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1640/2971] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:24.687228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:24.688376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:24.694679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:24.695125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:24.695877 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:24.696314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:24.820279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:24.828019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2e2bc796-88fc-4b7c-99b5-84c7bc2b7632 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144908 May 05 14:24:24.828654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1332/2972] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:25.845157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:25.846561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:25.853232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:25.853689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:25.854486 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:25.854931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:25.991211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:25.998982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-87f47241-3998-4181-a657-2df9aa9b9a76 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.158173 May 05 14:24:25.999541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1641/2973] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:27.021880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:27.022545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:27.028886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:27.029343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:27.030149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:27.030600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:27.165947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:27.173871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ebe27fe5-2a82-42f1-8f0b-10e25c5a3237 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155870 May 05 14:24:27.174463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1333/2974] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:28.190951 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:28.191598 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:28.197628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:28.198113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:28.198870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:28.199308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:28.327332 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:28.335120 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5753745a-94ee-40c8-a612-e6b189d50896 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148061 May 05 14:24:28.335674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1642/2975] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:29.352548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:29.353214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:29.359764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:29.360215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:29.360968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:29.361400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:29.490356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:29.498222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d8e3bdbe-ae3d-4dad-826c-a5d580ac4f3c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149471 May 05 14:24:29.498777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1334/2976] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:30.515863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:30.516410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:30.522843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:30.523298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:30.524061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:30.524502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:30.648226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:30.655882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fa8ca854-3777-4ae8-a16e-49c665516a13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144296 May 05 14:24:30.656938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1643/2977] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:31.673996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:31.674632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:31.680938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:31.681383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:31.682332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:31.682770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:31.816638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:31.824733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b9087df7-4e59-4ffc-82c2-c871457dbeda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155140 May 05 14:24:31.825295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1335/2978] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:32.842163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:32.842764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:32.849185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:32.849638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:32.850429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:32.850878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:32.975837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:32.983970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-aef6937d-b418-467a-8892-6c09cd6b6dd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145733 May 05 14:24:32.985094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1644/2979] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:34.002508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:34.003183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:34.009458 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:34.009907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:34.010734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:34.011168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:34.141394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:34.149070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5da9a8dd-2619-4244-abf9-4c3b8158a8cb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151143 May 05 14:24:34.149636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1336/2980] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:35.166796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:35.167416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:35.173831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:35.174317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:35.175084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:35.175525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:35.299537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:35.307394 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c0568e07-62c2-49db-b041-afc63746dd7a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144567 May 05 14:24:35.307963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1645/2981] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:36.324553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:36.325164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:36.332330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:36.332776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:36.333531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:36.333968 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:36.457647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:36.465349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0576945f-2e48-4f39-bd33-029833f0ae95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144574 May 05 14:24:36.465907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1337/2982] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:37.482699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:37.483320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:37.490864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:37.491314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:37.492079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:37.492519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:37.620179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:37.627918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4e59e4cc-fa80-4ed4-a80c-2b249f244793 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149485 May 05 14:24:37.628487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1646/2983] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:38.645916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:38.646560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:38.652826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:38.653271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:38.654035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:38.654478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:38.780463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:38.788659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3a33501e-7721-4202-bb4b-1c553a9dbc1f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146625 May 05 14:24:38.789221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1338/2984] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:39.805923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:39.806623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:39.813049 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:39.813508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:39.814306 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:39.814756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:39.942580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:39.950408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3281b43c-619c-47bf-9dee-d3c63a4513ea tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148375 May 05 14:24:39.950978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1647/2985] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:40.968793 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:40.969430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:40.975792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:40.976244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:40.977176 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:40.977436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:41.100035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:41.108115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-508e9cc3-c3df-45be-9083-c271fd678439 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143710 May 05 14:24:41.108671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1339/2986] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:42.126830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:42.127450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:42.133751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:42.134243 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:42.135004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:42.135439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:42.280545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:42.288352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-322350e6-cd3a-4bb1-b487-6838f9579d06 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.166010 May 05 14:24:42.288927 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1648/2987] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:43.306068 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:43.307292 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:43.314345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:43.315046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:43.315817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:43.316260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:43.441734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:43.449537 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-27cf5480-c765-47c7-aa42-64547112d7f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147375 May 05 14:24:43.450124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1340/2988] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:44.467366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:44.467928 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:44.474295 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:44.474753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:44.475525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:44.475968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:44.606135 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:44.614631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-03335dd7-6a61-4943-a138-ccfbb1c16d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151254 May 05 14:24:44.615193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1649/2989] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:45.631767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:45.632406 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:45.638734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:45.639183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:45.639940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:45.640944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:45.767311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:45.775083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-62067cf7-bbff-4890-acc7-65217ddff016 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147157 May 05 14:24:45.775641 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1341/2990] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:46.791831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:46.792516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:46.799563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:46.800015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:46.800775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:46.801211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:46.925087 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:46.932921 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83053bfe-e51c-45a9-9df0-26602ec67111 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145031 May 05 14:24:46.933473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1650/2991] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:47.950613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:47.951247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:47.957901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:47.958397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:47.959167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:47.959610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:48.089334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:48.098746 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-36ecedba-5dab-471a-9d11-d9bc5b6ad35e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151937 May 05 14:24:48.100707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1342/2992] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:49.118496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:49.119482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:49.129424 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:49.130157 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:49.131327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:49.132002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:49.268101 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:49.275924 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-26ff53b1-be8e-4cc8-8cd9-054ac6c43d09 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.163486 May 05 14:24:49.276484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1651/2993] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:50.292873 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:50.293525 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:50.300097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:50.300554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:50.301320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:50.301764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:50.424576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:50.432329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4be27844-2781-48f4-bae0-0022ee58acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143478 May 05 14:24:50.432900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1343/2994] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:51.449608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:51.450188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:51.456529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:51.456983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:51.457748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:51.458218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:51.585493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:51.593765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b1186e2-11d9-4dff-a018-e5ee6009b4ee tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147739 May 05 14:24:51.594354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1652/2995] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:52.611722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:52.612354 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:52.618796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:52.619251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:52.620019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:52.620478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:52.744048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:52.752468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a36eee3c-d544-407e-9163-1cf10eabf5ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145441 May 05 14:24:52.753038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1344/2996] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:53.768674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:53.769291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:53.775745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:53.776200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:53.776967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:53.777422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:53.906887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:53.914605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fcd669ea-8ef8-492b-89ab-38b2fd05773a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149853 May 05 14:24:53.915172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1653/2997] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:54.932503 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:54.933121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:54.940149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:54.940594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:54.941345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:54.941778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:55.064122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:55.071833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8223f24c-ec46-4a96-948c-7dfbf0cd8c43 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143258 May 05 14:24:55.072394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1345/2998] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:56.088948 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:56.089547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:56.096162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:56.096615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:56.097386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:56.097868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:56.231121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:56.239599 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8f0c2eaf-ef95-47c0-a252-f8ec3b132d83 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154794 May 05 14:24:56.240153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1654/2999] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:57.256706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:57.257318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:57.263801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:57.264254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:57.265047 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:57.266039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:57.394074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:57.401933 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e6854634-bd5f-415b-aa97-f01f8558ca31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149019 May 05 14:24:57.402526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1346/3000] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:58.419487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:58.420027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:58.426470 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:58.426920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:58.427709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:58.428144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:58.550662 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:58.558404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d2251cc3-89b9-4676-84fc-747aa8d650c9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.142972 May 05 14:24:58.558962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1655/3001] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:24:59.575948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:24:59.576632 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:24:59.583501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:59.583952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:59.584709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:24:59.585146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:24:59.711080 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:24:59.718812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1c04b63-7d74-47af-b4b7-e35d32b3ba85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146697 May 05 14:24:59.719377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1347/3002] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:24:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:00.736007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:00.736627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:00.743028 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:00.743487 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:00.744252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:00.744698 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:00.879350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:00.887121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-609a915c-1b72-467f-b624-c6e557c67a9f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155788 May 05 14:25:00.887678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1656/3003] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:01.903287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:01.903898 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:01.910216 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:01.910670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:01.911424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:01.911858 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:02.036900 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:02.044558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-15cba8b3-9827-4275-afb4-408864874b22 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145152 May 05 14:25:02.045120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1348/3004] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:03.061639 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:03.062219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:03.069386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:03.069835 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:03.070627 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:03.071067 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:03.199058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:03.206960 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc18f76e-1dba-4bbd-9e4d-2c87d96ee167 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149250 May 05 14:25:03.207534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1657/3005] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:04.223361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:04.223974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:04.230305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:04.230752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:04.231508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:04.231945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:04.356219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:04.364246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-76b71470-d411-47ba-95b9-f818a4d53c44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144686 May 05 14:25:04.364852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1349/3006] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:05.381254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:05.381811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:05.388203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:05.388657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:05.389419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:05.389858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:05.518632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:05.526435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-35ddad2b-4b8a-4268-bdc9-80f7310e6f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149061 May 05 14:25:05.527016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1658/3007] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:06.544164 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:06.544714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:06.551601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:06.552052 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:06.552804 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:06.553236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:06.680311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:06.688055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c8c6088-d4a4-47f7-9194-6b9cd565d917 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147747 May 05 14:25:06.689182 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1350/3008] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:07.706482 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:07.707096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:07.713752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:07.714238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:07.715000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:07.715438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:07.842051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:07.849794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d160992a-1961-41eb-a853-a7ed40757789 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147750 May 05 14:25:07.850393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1659/3009] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:08.867356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:08.867955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:08.874408 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:08.874862 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:08.875628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:08.876098 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:09.004046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:09.011821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-befbb2c3-4cbf-4b8d-be03-1d8c3b793d66 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148335 May 05 14:25:09.012383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1351/3010] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:10.029536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:10.030222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:10.037245 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:10.037702 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:10.038503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:10.038949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:10.167548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:10.175348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a56d35a-d3fc-40c5-8e87-d77355ea1a6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149719 May 05 14:25:10.175913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1660/3011] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:11.193028 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:11.193688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:11.200064 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:11.200517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:11.201293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:11.201740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:11.325277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:11.333091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a17bd830-d720-419e-bb08-763f1b1bd60a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143987 May 05 14:25:11.333650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1352/3012] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:12.350785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:12.351421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:12.358164 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:12.358593 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:12.359345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:12.359778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:12.489207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:12.498823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-47f2970e-6d82-403c-954d-abac5db0e05c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151945 May 05 14:25:12.499393 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1661/3013] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:13.515872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:13.516495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:13.522875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:13.523332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:13.524101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:13.524551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:13.651573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:13.659454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dcc02c84-6ef0-44e9-96c4-af3a020f89de tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147448 May 05 14:25:13.660102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1353/3014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:14.676671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:14.677316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:14.683725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:14.684174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:14.684932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:14.685368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:14.809012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:14.817197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38079563-abdd-40fd-ba86-aaf0209b702c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144430 May 05 14:25:14.817769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1662/3015] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:15.834370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:15.834986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:15.841332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:15.841785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:15.842583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:15.843019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:15.969723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:15.977533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b2208a2d-9e33-4734-b795-ce4eac063994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147088 May 05 14:25:15.978120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1354/3016] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:16.996085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:16.996811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:17.003524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:17.003981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:17.004786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:17.005224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:17.135372 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:17.143547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-60f8114a-f6d5-403a-a03c-9b8c66d8ae6a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151310 May 05 14:25:17.144119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1663/3017] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:18.161171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:18.161789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:18.168545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:18.168994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:18.169751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:18.170215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:18.301425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:18.309165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cf3c84bb-a627-4ad4-a152-82953c0340ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151928 May 05 14:25:18.309720 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1355/3018] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:19.326572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:19.327335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:19.333812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.334304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.335076 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.335516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.361272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:19.361840 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:19.368325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.368781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.369589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.375445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.385271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. May 05 14:25:19.385860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:25:19.386739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-20a28bdc-1e4a-4b5c-adbc-5071acce046b tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 404 len: 111 microversion: 2.20 time: 0.030141 May 05 14:25:19.387589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1356/3019] 10.222.0.26 () {60 vars in 1279 bytes} [Thu May 5 14:25:19 2022] DELETE /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 05 14:25:19.395436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:19.396056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] [instance: df2dfe03-fd03-4632-8c71-c9fcd83a94d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:19.402158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.403106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.403895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:19.404338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:19.418767 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] HTTP exception thrown: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. May 05 14:25:19.419351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] Returning 404 to user: Instance df2dfe03-fd03-4632-8c71-c9fcd83a94d7 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:25:19.420807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-06731863-3fba-4785-8840-f53d42cd0985 tempest-AttachVolumeShelveTestJSON-792507157 tempest-AttachVolumeShelveTestJSON-792507157-project] 10.222.0.26 "GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7" status: 404 len: 111 microversion: 2.20 time: 0.028978 May 05 14:25:19.421431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1357/3020] 10.222.0.26 () {60 vars in 1276 bytes} [Thu May 5 14:25:19 2022] GET /compute/v2.1/servers/df2dfe03-fd03-4632-8c71-c9fcd83a94d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 05 14:25:19.485334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:19.493203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8de29cc8-e550-47d2-8388-e07271284c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.170444 May 05 14:25:19.493769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1664/3021] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:20.510536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:20.511191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:20.517809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:20.518283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:20.519044 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:20.519480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:20.648351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:20.652874 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83f83f2e-04ce-40b2-9b86-14d854b7418f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146156 May 05 14:25:20.653436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1358/3022] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:21.670519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:21.671131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:21.678316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:21.678766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:21.679723 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:21.680156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:21.877122 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:21.885062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8b31eb0b-4caa-49c9-87af-d47b3ebb957f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.218300 May 05 14:25:21.885650 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1665/3023] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:22.903055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:22.903678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:22.910666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:22.911124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:22.911902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:22.912345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:23.063996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:23.072192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5222fc7a-5a97-43d8-9308-404b25c0945d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.172858 May 05 14:25:23.072684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1359/3024] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:25:24.089425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:24.090064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:24.097116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:24.097568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:24.098366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:24.098802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:24.233439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:24.241348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-99fe80a0-69f7-497f-92f5-0d73f58b3d07 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155739 May 05 14:25:24.242003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1666/3025] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:25:25.261456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:25.262438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:25.271854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:25.272533 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:25.273719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:25.274415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:25.472942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:25.481225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-84f0bb3b-876a-4b78-a9ec-44aa4a47a8ec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.226157 May 05 14:25:25.481814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1360/3026] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:26.499259 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:26.499884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:26.508040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:26.509064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:26.510671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:26.512782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:26.741646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:26.750268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-27bdf10d-fe5c-4a4a-b58b-dde2249a7c69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.254890 May 05 14:25:26.751178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1667/3027] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:27.773763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:27.774957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:27.782626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:27.783184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:27.783960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:27.784400 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:28.007692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:28.015813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4707065a-3527-455a-93a3-8b7fe5ecabda tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.246474 May 05 14:25:28.016518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1361/3028] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:29.033642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:29.034282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:29.040178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:29.040631 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:29.041421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:29.041855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:29.192660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:29.200581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cc96f654-2951-4886-8339-f8d39f51916e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.171724 May 05 14:25:29.201146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1668/3029] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:30.219325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:30.221421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:30.228555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:30.229013 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:30.229796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:30.234120 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:30.384377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:30.392493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a9f8c821-db94-488a-b38b-6f197cf71d90 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.177460 May 05 14:25:30.400404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1362/3030] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:30.441641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: .version_select at 0x7fb4ec211310>, body: {"keypair": {"name": "tempest-keypair-313916697"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:25:30.455888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:25:30.459805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:25:30.649594 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:25:30.653269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:25:30.666350 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-33481e2e-ef3d-4250-aeba-b7b7a8db4d52 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.364080 May 05 14:25:30.666940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1669/3031] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 14:25:30 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:31.410090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:31.411273 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:31.418505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:31.419106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:31.419940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:31.420454 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:31.743252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:31.751830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-938fd1ed-c358-446e-8067-f53b0557164d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.345059 May 05 14:25:31.752423 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1363/3032] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:32.769902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:32.770558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:32.777530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:32.777985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:32.778781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:32.779226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:32.859964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2112594744", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "174b3825-61b6-4e7e-9ac6-6071af022321"}], "security_groups": [{"name": "tempest-securitygroup--253719060"}], "key_name": "tempest-keypair-313916697", "user_data": "}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:25:32.913765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:32.921769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc6da69e-e3ba-4f31-abc4-813f43a50b5e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.156816 May 05 14:25:32.922586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1670/3033] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:32.978835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] validate_networks() for [('174b3825-61b6-4e7e-9ac6-6071af022321', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:25:33.450771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:25:33.451312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:25:33.451904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:25:33.452425 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:25:33.452944 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:25:33.462534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:33.462977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:33.463773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:33.464554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:33.494100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:25:33.498595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:25:33.511083 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:25:33.513372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:25:33.661794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-191b023b-da8c-42cb-9cfb-7fcb8ecf6023 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.806348 May 05 14:25:33.663136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1364/3034] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:25:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 05 14:25:33.673476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eed39d1e-38f8-4d9c-912c-d21f2422117a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:33.674231 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eed39d1e-38f8-4d9c-912c-d21f2422117a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:33.746687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-eed39d1e-38f8-4d9c-912c-d21f2422117a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:33.754729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eed39d1e-38f8-4d9c-912c-d21f2422117a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1241 microversion: 2.1 time: 0.085437 May 05 14:25:33.755404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1671/3035] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:33 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:33.940200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:33.940830 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:33.948679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:33.949134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:33.949910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:33.950375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:34.084293 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:34.092752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-949df74e-633e-4bc9-b6e3-a01391f1b70a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.156871 May 05 14:25:34.093468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1365/3036] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:34.772165 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f78bd6a8-ea8e-4292-add7-0712aa340c1a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:34.772786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f78bd6a8-ea8e-4292-add7-0712aa340c1a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:34.827944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f78bd6a8-ea8e-4292-add7-0712aa340c1a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:34.842364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f78bd6a8-ea8e-4292-add7-0712aa340c1a tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1241 microversion: 2.1 time: 0.068588 May 05 14:25:34.842364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1672/3037] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:34 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:35.110301 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:35.113252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:35.117476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:35.117935 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:35.118748 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:35.119196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:35.256102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:35.264023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d989481f-8539-4e9f-993c-45a0f23d303d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.157855 May 05 14:25:35.264607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1366/3038] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:35.852769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:35.853510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:35.861228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:35.862292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:35.863078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:35.863526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:35.929829 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:35.937169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-52d4bc61-d070-4933-b464-0c6df751bc45 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1301 microversion: 2.1 time: 0.088349 May 05 14:25:35.937741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1673/3039] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:35 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:36.280910 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:36.281532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:36.288045 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:36.288328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:36.289092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:36.289536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:36.521115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:36.528978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5cce4c7d-12e2-4ee9-9b3c-3cd09527c77c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.251906 May 05 14:25:36.529539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1367/3040] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:36.955938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:36.956687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:36.965491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:36.965720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:36.968055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:36.968055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:37.171915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:37.179963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ba95d0c8-26bf-4a9b-8d9a-ca123fcc6aab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.228867 May 05 14:25:37.180621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1674/3041] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:36 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:37.547763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:37.548361 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:37.554692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:37.555136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:37.555890 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:37.556330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:37.769577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:37.778809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8a83bb98-acbb-4e5c-b5a2-50ac40904d8d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.234820 May 05 14:25:37.779951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1368/3042] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:38.056416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-a8b9d3e6-766e-44ff-be8b-59c4c31e7ecd req-5abc1b65-8cbb-48f6-bb2b-587c00742086 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7dcc206-30ae-4507-a017-691404eef1bc", "tag": "92faf560-127a-4ed6-b84f-ea8ab273fe1e"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:25:38.064642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-a8b9d3e6-766e-44ff-be8b-59c4c31e7ecd req-5abc1b65-8cbb-48f6-bb2b-587c00742086 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:38.065093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-a8b9d3e6-766e-44ff-be8b-59c4c31e7ecd req-5abc1b65-8cbb-48f6-bb2b-587c00742086 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:38.076660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-a8b9d3e6-766e-44ff-be8b-59c4c31e7ecd req-5abc1b65-8cbb-48f6-bb2b-587c00742086 service nova] Creating event network-changed:92faf560-127a-4ed6-b84f-ea8ab273fe1e for instance a7dcc206-30ae-4507-a017-691404eef1bc on hv-cinder-73761 May 05 14:25:38.081939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-a8b9d3e6-766e-44ff-be8b-59c4c31e7ecd req-5abc1b65-8cbb-48f6-bb2b-587c00742086 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092402 May 05 14:25:38.082758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1675/3043] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:25:38.198789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:38.199414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:38.206810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:38.207265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:38.208049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:38.208490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:38.403118 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:38.411101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-780505a8-a36d-47ba-a27c-40aef4169142 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.216136 May 05 14:25:38.411667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1369/3044] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:38 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:38.796983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:38.797694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:38.803889 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:38.804345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:38.805116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:38.805555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:38.938104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:38.946499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-029e0cf0-2d90-4a70-afb6-f3e78c908096 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153731 May 05 14:25:38.947063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1676/3045] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:39.428316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:39.428939 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:39.435266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:39.435716 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:39.436478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:39.436915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:39.559734 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:39.566973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-643af06d-f3f0-47c9-b51e-852a6f5ea16b tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.143179 May 05 14:25:39.567522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1370/3046] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:39 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:39.964367 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:39.964940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:39.972062 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:39.972510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:39.973270 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:39.973711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:40.101264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:40.109515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-145705cd-d7d5-4f6e-96f9-07121be75c95 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149110 May 05 14:25:40.110096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1677/3047] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:40.582835 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:40.583445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:40.589730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:40.590222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:40.590976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:40.591407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:40.731031 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:40.739341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3e0eb641-81c2-4ecb-ae18-627a0694b2f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.160342 May 05 14:25:40.739894 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1371/3048] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:40 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:41.126811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:41.127767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:41.134147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:41.134595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:41.135347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:41.135782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:41.262045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:41.270364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4de7a5be-cd1e-430b-ab71-f21cc330c27c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147449 May 05 14:25:41.270929 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1678/3049] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:41.756645 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:41.757256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:41.763619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:41.764066 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:41.764850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:41.765279 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:41.892090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:41.900147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d0c45395-02b8-4157-b9d0-ebc8ee3223b2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.148049 May 05 14:25:41.900689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1372/3050] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:41 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:42.287937 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:42.288546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:42.294839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:42.295292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:42.296046 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:42.296479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:42.431138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:42.438936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b85d62dc-111c-4225-b905-41462e8de56d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154822 May 05 14:25:42.439532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1679/3051] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:42.916985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:42.917593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:42.924377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:42.925227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:42.925601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:42.926057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:43.070929 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:43.078323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-257766ff-a763-485c-b7fe-675ac8239880 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.165352 May 05 14:25:43.078882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1373/3052] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:42 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:43.456224 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:43.456846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:43.463329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:43.463790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:43.464559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:43.465004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:43.592869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:43.610177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-191ecf72-790f-4636-b399-936c7b344366 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.157743 May 05 14:25:43.610775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1680/3053] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:44.095460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:44.096593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:44.103486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:44.103486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:44.104198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:44.104638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:44.239604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:44.246993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9c19852b-c7d5-48a5-b563-23219272f161 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.155449 May 05 14:25:44.247547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1374/3054] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:44 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:44.588160 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-2d935e70-e4ca-4f03-9f3a-941a0ceb50b0 req-ec02afb5-05f4-43c0-8f48-9481dfdee6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dcc206-30ae-4507-a017-691404eef1bc", "name": "network-vif-plugged", "status": "completed", "tag": "92faf560-127a-4ed6-b84f-ea8ab273fe1e"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:25:44.597437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-2d935e70-e4ca-4f03-9f3a-941a0ceb50b0 req-ec02afb5-05f4-43c0-8f48-9481dfdee6d3 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:44.597880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-2d935e70-e4ca-4f03-9f3a-941a0ceb50b0 req-ec02afb5-05f4-43c0-8f48-9481dfdee6d3 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:44.609896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-2d935e70-e4ca-4f03-9f3a-941a0ceb50b0 req-ec02afb5-05f4-43c0-8f48-9481dfdee6d3 service nova] Creating event network-vif-plugged:92faf560-127a-4ed6-b84f-ea8ab273fe1e for instance a7dcc206-30ae-4507-a017-691404eef1bc on hv-cinder-73761 May 05 14:25:44.615038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-2d935e70-e4ca-4f03-9f3a-941a0ceb50b0 req-ec02afb5-05f4-43c0-8f48-9481dfdee6d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086817 May 05 14:25:44.615884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1681/3055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:25:44.629323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:44.629943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:44.636744 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:44.637198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:44.637971 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:44.638431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:44.849702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:44.857731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-01710fc0-946f-4baf-8d79-e9806ca97184 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.232786 May 05 14:25:44.858626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1375/3056] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:45.264108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:45.264766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:45.271904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:45.272358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:45.273126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:45.273565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:45.402287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:45.409463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d1a5e02b-8791-45b9-89fc-bae0e7e8fa22 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.149624 May 05 14:25:45.410040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1682/3057] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:45 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:45.875504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:45.876106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:45.883097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:45.883551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:45.884311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:45.884750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:46.019437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:46.027268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-115f9584-a677-4c36-9807-946487c8d516 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155612 May 05 14:25:46.027829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1376/3058] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:46.426775 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:46.427384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:46.433857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:46.434337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:46.435090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:46.435525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:46.562565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:46.570330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ccee0e5b-9a4f-465b-ab5c-f8e34af01f53 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1366 microversion: 2.1 time: 0.148016 May 05 14:25:46.570886 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1683/3059] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:46 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:47.044671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:47.045283 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:47.052236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.052690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.053452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.053892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.178821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:47.186538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7b965ec2-bce1-4661-b79b-46a61581a442 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145741 May 05 14:25:47.187090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1377/3060] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:47.587036 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:47.587575 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:47.593878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.594358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.595112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.595546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.721578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:47.728867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dbdd4d75-fd21-4b86-9509-3bfa2e9c020f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1557 microversion: 2.1 time: 0.145849 May 05 14:25:47.729436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1684/3061] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:47 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:47.745081 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:47.745575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:47.751415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.752384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.753139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:47.753570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:47.826647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-01d06c62-eb14-4ff9-b594-f9cdc61eda10 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.085439 May 05 14:25:47.827235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1378/3062] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 14:25:47 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:25:48.203655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:48.204493 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:48.210661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:48.211179 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:48.212060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:48.212513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:48.405915 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:48.414330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d37909a-b7be-4ce5-a7e1-8151a4cd8c93 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.214633 May 05 14:25:48.414903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1685/3063] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:49.171590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-b21ff699-85f0-4f92-81a5-0fe0c79ac906 req-fdeab25c-bad5-4bca-81b4-415d74d11ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7dcc206-30ae-4507-a017-691404eef1bc", "tag": "92faf560-127a-4ed6-b84f-ea8ab273fe1e"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:25:49.179553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b21ff699-85f0-4f92-81a5-0fe0c79ac906 req-fdeab25c-bad5-4bca-81b4-415d74d11ac0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:49.179988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b21ff699-85f0-4f92-81a5-0fe0c79ac906 req-fdeab25c-bad5-4bca-81b4-415d74d11ac0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:49.191276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-b21ff699-85f0-4f92-81a5-0fe0c79ac906 req-fdeab25c-bad5-4bca-81b4-415d74d11ac0 service nova] Creating event network-changed:92faf560-127a-4ed6-b84f-ea8ab273fe1e for instance a7dcc206-30ae-4507-a017-691404eef1bc on hv-cinder-73761 May 05 14:25:49.197039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-b21ff699-85f0-4f92-81a5-0fe0c79ac906 req-fdeab25c-bad5-4bca-81b4-415d74d11ac0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029458 May 05 14:25:49.197857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1379/3064] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:25:49.432480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:49.433108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:49.440685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:49.441151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:49.442128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:49.442584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:49.571618 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:49.579417 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-59d51949-bcc5-4409-9619-49a913cf715c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150914 May 05 14:25:49.580526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1686/3065] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:50.597333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:50.598043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:50.604254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:50.604703 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:50.605462 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:50.605895 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:50.731826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:50.739987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-905e2ef6-fbc3-478c-8a7a-0da954ae0d4d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146961 May 05 14:25:50.740546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1380/3066] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:25:51.757201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:51.757752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:51.764094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:51.764566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:51.765329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:51.765767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:51.889296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:51.897682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ac3cd5a-2f8a-4557-93d6-c891bd3cf8e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144484 May 05 14:25:51.898287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1687/3067] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:52.916271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:52.916891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:52.924342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:52.924800 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:52.925570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:52.926024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:53.051459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:53.059550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1bc3ef78-d4f9-4a30-9a96-48398a5866dd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147206 May 05 14:25:53.062466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1381/3068] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:54.081284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:54.081897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:54.088222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:54.088670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:54.089456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:54.089891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:54.216514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:54.224852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc55d652-0ff1-4b12-aac2-fe7cba4415a1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147997 May 05 14:25:54.225406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1688/3069] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:55.242916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:55.243463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:55.249838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:55.250320 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:55.251079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:55.251513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:55.375202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:55.382986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-91702f60-b6a7-48d9-b3fa-cc1c6dedd95a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143998 May 05 14:25:55.383547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1382/3070] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:56.400568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:56.401202 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:56.407527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:56.408008 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:56.408759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:56.409197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:56.536655 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:56.544458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3b70f2ae-bf83-4e1d-864f-64424204f32f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147756 May 05 14:25:56.545022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1689/3071] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:57.562573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:57.563124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:57.569941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:57.570419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:57.571172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:57.571605 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:57.710579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:57.718429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f8b811e5-2f89-4753-bcea-ee86a4a83f31 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.159805 May 05 14:25:57.718999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1383/3072] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:58.736414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:58.737035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:58.743011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:58.743467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:58.744233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:58.744676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:58.869252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:25:58.877052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2cc74332-20ab-4c7b-9c62-0336292a03ba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145007 May 05 14:25:58.877621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1690/3073] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:25:59.895580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:25:59.896193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:25:59.902513 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:59.902960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:25:59.903715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:25:59.904149 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:00.031249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:00.039568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f93f6996-2201-4c54-bf2e-7ed025911dca tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148364 May 05 14:26:00.040125 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1384/3074] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:25:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:01.056852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:01.057510 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:01.063882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:01.064334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:01.065100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:01.065536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:01.189882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:01.198169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4a1291a9-d035-4f6f-892a-adf3bd5ee6f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145282 May 05 14:26:01.198738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1691/3075] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:02.216184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:02.216802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:02.223803 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:02.224255 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:02.225017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:02.225459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:02.350738 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:02.358806 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-56956438-7f73-4b82-9d1c-2b159b8109e9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146430 May 05 14:26:02.359305 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1385/3076] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:03.376171 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:03.376740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:03.383830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:03.384286 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:03.385058 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:03.385501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:03.507794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:03.515534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-460420cb-3b16-4958-a196-19d2fc3f8ba1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143353 May 05 14:26:03.516114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1692/3077] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:04.532798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:04.533441 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:04.540565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:04.541011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:04.541833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:04.542298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:04.673671 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:04.681509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4946e04c-04fe-4c54-b426-8ba3b0db6cd1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.152663 May 05 14:26:04.682084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1386/3078] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:05.698699 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:05.699311 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:05.705663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:05.706173 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:05.707524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:05.707964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:05.830106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:05.838428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c3bfe351-5c0c-4609-8b4f-57e78aed972e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143555 May 05 14:26:05.838987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1693/3079] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:06.855814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:06.857042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:06.863550 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:06.864059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:06.864851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:06.865284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:06.989713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:06.997686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-237bcff6-b10c-456d-82ce-d92adda24654 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145782 May 05 14:26:06.998277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1387/3080] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:08.015685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:08.016262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:08.023183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:08.023656 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:08.024410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:08.024845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:08.153461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:08.161188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-99728a3b-2f6e-481f-aaf5-6b6df7d188a8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149515 May 05 14:26:08.161755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1694/3081] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:09.178579 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:09.179191 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:09.185572 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:09.186035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:09.186811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:09.187249 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:09.310615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:09.318907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7d9dcaa8-f3fa-4c13-8c1e-ceb4c7ad6992 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144295 May 05 14:26:09.319467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1388/3082] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:10.337211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:10.337824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:10.344290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:10.344906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:10.345666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:10.346131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:10.473225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:10.481073 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d5b7af15-0869-417d-8e80-a6a22b8fa4d2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147735 May 05 14:26:10.481671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1695/3083] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:11.631459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:11.632082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:11.638070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:11.640422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:11.640422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:11.640422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:11.813333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:11.821603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec215c2a-3102-4e35-bf33-f42e8e90c69c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.326730 May 05 14:26:11.822195 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1389/3084] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:12.839452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:12.840108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:12.846560 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:12.847017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:12.847781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:12.848222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:12.980508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:12.988740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83b6c5a5-a567-441d-aed9-b9730012b375 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153157 May 05 14:26:12.989308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1696/3085] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:14.006740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:14.007364 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:14.013608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:14.014075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:14.014831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:14.015265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:14.142385 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:14.150810 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f7363440-9f88-426c-b041-928b2592cfe6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148474 May 05 14:26:14.151377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1390/3086] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:15.167987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:15.168630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:15.175035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:15.175485 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:15.176240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:15.177209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:15.317566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:15.325345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6964ede9-41b7-49bf-ba1b-6bbd79acc8ff tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.161236 May 05 14:26:15.325908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1697/3087] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:16.342430 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:16.343046 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:16.350001 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:16.350477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:16.351254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:16.351699 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:16.480057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:16.488286 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f2ce9293-6998-4c73-95d7-912975d81ae8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149630 May 05 14:26:16.488860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1391/3088] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:17.505216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:17.505786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:17.513483 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:17.513936 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:17.514734 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:17.515177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:17.637978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:17.646515 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b4026334-c0a1-4b93-9df8-8bc4e99bc376 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145786 May 05 14:26:17.647085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1698/3089] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:18.580390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:18.580943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:18.587790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:18.588239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:18.588999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:18.589438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:18.612217 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c7bb72be-9a4b-430c-9ce4-34ee2d5c3f4f tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc/ips" status: 200 len: 151 microversion: 2.1 time: 0.035691 May 05 14:26:18.612758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1392/3090] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 14:26:18 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:26:18.664119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:18.664746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:18.671108 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:18.671561 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:18.672323 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:18.672763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:18.806343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:18.814719 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e5e66333-c2dd-473f-8461-16a88cda7ea5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155043 May 05 14:26:18.815392 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1699/3091] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:19.832295 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:19.833490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:19.839452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:19.839903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:19.840658 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:19.841092 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:19.968371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:19.976148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9808db4a-c62b-430e-ab28-6bd24d752ea9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147871 May 05 14:26:19.976707 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1393/3092] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:20.994366 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:20.994988 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:21.001354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:21.001804 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:21.002590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:21.003026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:21.133558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:21.141349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-205019a8-7d72-4998-8495-5a1530ef08a6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150852 May 05 14:26:21.141916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1700/3093] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:22.162483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:22.163105 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:22.169505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:22.169958 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:22.170751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:22.171190 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:22.298991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:22.307392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8cd608c4-f899-4208-acb2-c6ab70e03a24 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148790 May 05 14:26:22.307956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1394/3094] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:23.325204 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:23.325828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:23.332321 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:23.333283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:23.334069 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:23.334519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:23.458931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:23.466758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d1b60245-ddf5-46e6-957f-29283884c899 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145489 May 05 14:26:23.467334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1701/3095] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:24.483710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:24.484366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:24.491398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:24.491853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:24.492618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:24.493060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:24.620387 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:24.628161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3d6f8b83-da09-4e67-8452-41ea90a3300f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148595 May 05 14:26:24.628717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1395/3096] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:25.644667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:25.645794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:25.652150 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:25.652601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:25.653365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:25.653802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:25.778378 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:25.786177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8d38cf88-8eec-4aaf-98af-63427a769ecb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145370 May 05 14:26:25.786746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1702/3097] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:26.803908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:26.804532 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:26.811013 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:26.811470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:26.812240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:26.812691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:26.937869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:26.945760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec81a1bd-5e76-43ed-b04d-d7f11b10c2ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146381 May 05 14:26:26.946464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1396/3098] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:27.964251 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:27.964884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:27.971680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:27.986246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:27.986246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:27.986246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:28.107830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:28.115870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7218ca7d-ac0e-461e-a0cd-a8eff49347fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155569 May 05 14:26:28.116427 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1703/3099] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:29.132690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:29.133298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:29.143624 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:29.144074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:29.144852 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:29.145796 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:29.275380 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:29.283790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da650c9e-22a5-4cb8-a09e-a58b6c22023b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155102 May 05 14:26:29.284351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1397/3100] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:30.301964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:30.302619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:30.308974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:30.309420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:30.310213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:30.310648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:30.436998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:30.445200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4c318db0-1285-41da-b4eb-2a8203b465bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147148 May 05 14:26:30.445764 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1704/3101] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:31.462311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:31.462934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:31.469248 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:31.469701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:31.470500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:31.470941 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:31.595325 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:31.603257 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-356dbc09-ea63-41ed-a916-5ec1f1d19cbc tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144764 May 05 14:26:31.603768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1398/3102] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:32.620589 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:32.621211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:32.628001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:32.628454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:32.629218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:32.630189 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:32.756352 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:32.764159 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ddcc4022-0c91-4864-acb2-52d9ecef2a33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147410 May 05 14:26:32.764725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1705/3103] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:33.782163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:33.782708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:33.789025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:33.789472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:33.790253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:33.790687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:33.913962 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:33.921601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-08167f42-1f33-408b-9fcb-576da428acd5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143415 May 05 14:26:33.922271 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1399/3104] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:34.939556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:34.940234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:34.947335 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:34.947784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:34.948541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:34.948974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:35.073333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:35.081017 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ddb0cecd-44b0-411f-af3d-d83d7ac73b69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145296 May 05 14:26:35.081578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1706/3105] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:36.098912 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:36.099616 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:36.106095 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:36.106546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:36.107309 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:36.107742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:36.242246 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:36.250657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-986517ab-b969-4448-bb0c-77e600148d26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155618 May 05 14:26:36.251215 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1400/3106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:37.267892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:37.268446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:37.275695 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:37.276152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:37.276919 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:37.277360 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:37.404578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:37.412623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ec7a5137-7b71-42d3-93ab-2405e328ac8c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148683 May 05 14:26:37.413192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1707/3107] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:38.429405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:38.429940 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:38.436265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:38.436711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:38.437463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:38.437896 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:38.563848 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:38.572310 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e6159939-95af-432a-80f6-7c355b8dda75 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146778 May 05 14:26:38.572887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1401/3108] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:39.589855 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:39.590499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:39.596879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:39.597333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:39.598129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:39.598573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:39.721246 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:39.729581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7d9310ad-c1c8-4eb9-8d44-6058f43cb983 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143584 May 05 14:26:39.730172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1708/3109] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:40.747184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:40.747730 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:40.754127 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:40.754585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:40.755352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:40.756317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:40.879590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:40.887897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0a31cf7d-4953-4cf4-a025-6d024efc28ed tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144644 May 05 14:26:40.888463 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1402/3110] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:41.904710 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:41.905267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:41.911765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:41.912875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:41.913671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:41.914139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:42.045910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:42.053834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e804c5fe-866c-4f87-8d39-af3e47a7226a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153073 May 05 14:26:42.054440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1709/3111] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:43.070613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:43.071312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:43.077439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:43.077885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:43.078685 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:43.079122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:43.215055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:43.224065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f207481a-6911-42d0-b5bf-d204b8da5f13 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.157343 May 05 14:26:43.225161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1403/3112] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:44.242151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:44.242884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:44.249229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:44.249683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:44.250475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:44.250918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:44.378585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:44.386903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-245f01ad-7cf3-4043-a179-77166dccf262 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148691 May 05 14:26:44.387665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1710/3113] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:45.405009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:45.405610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:45.412452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:45.412897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:45.413654 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:45.414114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:45.536706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:45.545145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-feb67c2c-87c8-46f0-ab09-d5b7f07f65fb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143975 May 05 14:26:45.545952 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1404/3114] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:46.564379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:46.564952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:46.571387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:46.571845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:46.572606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:46.573044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:46.701035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:46.709926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7a6bd843-66fb-48a6-aa74-dd534fcf1f02 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148914 May 05 14:26:46.710527 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1711/3115] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:47.727472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:47.728055 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:47.734727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:47.735331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:47.736096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:47.736535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:47.861565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:47.869369 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-047296ad-bafa-4d45-b6c3-8a060a0519d4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146154 May 05 14:26:47.869927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1405/3116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:48.886588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:48.887208 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:48.893717 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:48.894194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:48.894970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:48.895437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:49.019379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:49.027938 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-961d1e1a-ea4a-42c4-a914-baa0ac453dc0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145333 May 05 14:26:49.028509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1712/3117] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:50.045030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:50.045689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:50.051718 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:50.052171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:50.052930 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:50.053370 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:50.187151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:50.194881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3aa53ff5-d169-497d-838b-5eff439ed2c1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153717 May 05 14:26:50.195431 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1406/3118] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:51.212038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:51.212653 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:51.219015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:51.219467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:51.220223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:51.220659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:51.345801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:51.354161 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-44ec04ae-6e24-473c-975d-c74acd82166c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145949 May 05 14:26:51.354672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1713/3119] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:52.371829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:52.372386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:52.378812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:52.379266 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:52.380025 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:52.380461 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:52.505321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:52.513672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-dcd2d2f4-e89f-4206-8801-5a24a460f630 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145762 May 05 14:26:52.514265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1407/3120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:53.531020 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:53.531632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:53.538263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:53.538721 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:53.539497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:53.539941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:53.662777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:53.670620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6206523a-fdf2-4941-91df-f3270e3ea0e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143455 May 05 14:26:53.671188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1714/3121] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:26:54.687821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:54.688438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:54.695608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:54.696057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:54.696818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:54.697259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:54.819323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:54.827026 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e0a010be-ca7e-40a0-963f-2bd836ea7f69 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143107 May 05 14:26:54.827618 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1408/3122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:55.844670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:55.845316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:55.852131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:55.852577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:55.853330 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:55.853766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:55.985680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:55.994288 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b65c752f-38e4-4654-99c3-fbfa3cb891ad tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153456 May 05 14:26:55.994857 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1715/3123] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:57.012189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:57.012802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:57.019373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:57.019826 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:57.020582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:57.021016 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:57.146352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:57.154228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ecbc34b8-f6da-4b3f-a10d-bb50f1075935 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145909 May 05 14:26:57.156735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1409/3124] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:58.172284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:58.172905 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:58.178823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:58.179278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:58.180039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:58.180480 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:58.315080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:58.323368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-39ba18e4-80eb-43c9-9742-3d7ad3e64539 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155185 May 05 14:26:58.323930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1716/3125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:26:59.341038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:26:59.341655 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:26:59.348070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:59.348526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:59.349294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:26:59.350421 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:26:59.478315 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:26:59.486330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aa03d32a-8d6a-4b29-a5d6-a5bc2d8bad27 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149164 May 05 14:26:59.486888 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1410/3126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:26:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:00.503587 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:00.504152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:00.510505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:00.510990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:00.511752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:00.512193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:00.647740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:00.655449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-94bfe5e0-fab9-4501-9260-6cf2b6d8254a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155790 May 05 14:27:00.656009 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1717/3127] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:01.672901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:01.673453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:01.680282 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:01.680751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:01.681496 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:01.681928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:01.803823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:01.811529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ea53e27-16fa-409d-ad3d-255f13e98d56 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.142607 May 05 14:27:01.812093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1411/3128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:02.829320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:02.829931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:02.836869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:02.837317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:02.838085 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:02.838523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:02.961348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:02.969624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-15568826-7723-4c12-be20-90fdbe621fcf tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144169 May 05 14:27:02.978152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1718/3129] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:03.987882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:03.988493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:03.994814 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:03.995845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:03.995984 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:03.996418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:04.124955 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:04.133231 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7272478d-fd38-41e0-8eaf-2feabdc5d142 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149477 May 05 14:27:04.133790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1412/3130] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:05.150851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:05.151464 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:05.157863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:05.158342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:05.159096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:05.159529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:05.283540 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:05.293342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-68aca01b-9c87-4521-b68a-503c5f206e42 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146884 May 05 14:27:05.293947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1719/3131] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:06.315020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:06.315635 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:06.322096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:06.322555 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:06.323323 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:06.323765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:06.450102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:06.457936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-17452233-4e30-47f5-b071-4578c707e734 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146865 May 05 14:27:06.458526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1413/3132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:07.475201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:07.475871 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:07.482267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:07.488328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:07.488328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:07.488328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:07.607494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:07.616190 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-31a3be0a-f3db-422d-b560-7bbd1034ef23 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144878 May 05 14:27:07.619987 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1720/3133] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:08.633169 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:08.633760 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:08.640135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:08.640584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:08.641338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:08.641775 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:08.765542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:08.773244 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d4b8ad66-2e40-4e78-a1c7-f22d92e054f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144452 May 05 14:27:08.773811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1414/3134] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:09.791054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:09.791608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:09.797931 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:09.798416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:09.799170 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:09.799605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:09.925410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:09.933317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-22adac48-cf75-42f3-896c-0f86a8700c1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146882 May 05 14:27:09.940580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1721/3135] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:10.950456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:10.951076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:10.957453 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:10.957908 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:10.958697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:10.959140 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:11.082154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:11.090414 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-59e597f1-6056-4eeb-9b10-5760eff2709b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143838 May 05 14:27:11.090977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1415/3136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:12.108239 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:12.109223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:12.115592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:12.116044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:12.116809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:12.117247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:12.245151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:12.253055 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e3a2f10-ab5a-4a46-8e79-09a424a3ef28 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148715 May 05 14:27:12.253628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1722/3137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:13.270639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:13.271360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:13.277647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:13.278130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:13.278901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:13.279336 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:13.407229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:13.414987 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-790870be-7e11-40e9-92f1-867a76bc5092 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148334 May 05 14:27:13.415553 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1416/3138] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:14.433095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:14.433621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:14.439913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:14.440361 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:14.441114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:14.441544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:14.568043 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:14.575846 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b8d027c5-fd66-4e5e-b345-38523e718c49 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146699 May 05 14:27:14.576396 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1723/3139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:15.592792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:15.593415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:15.599868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:15.600422 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:15.601708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:15.602189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:15.726887 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:15.734861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-75005719-2692-42b3-b5e7-88abbaf36972 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146001 May 05 14:27:15.735432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1417/3140] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:16.752125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:16.752746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:16.759600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:16.760047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:16.760811 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:16.761252 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:16.944672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:16.952548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e344af0d-bb97-4305-9bf3-93ec551c4275 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.204307 May 05 14:27:16.953114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1724/3141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:17.969644 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:17.970294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:17.977239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:17.977682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:17.978456 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:17.978892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:18.104972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:18.113063 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-934932d9-3103-42da-b70c-2d9eb081713d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147353 May 05 14:27:18.113619 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1418/3142] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:18.697714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:18.698301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:18.704519 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:18.704967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:18.705725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:18.706203 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:18.731798 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:27:18.980648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6257090a-1678-4b05-8624-3e39679f6b57 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 204 len: 0 microversion: 2.1 time: 0.287048 May 05 14:27:18.981191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1725/3143] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:27:18 2022] DELETE /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:27:18.989647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:18.990319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:18.996436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:18.996886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:18.997639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:18.998093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:19.122889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:19.130261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83ccce10-46cf-47d9-bc7f-8cda314d2366 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1682 microversion: 2.1 time: 0.144349 May 05 14:27:19.130774 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:19.130942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1419/3144] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:18 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1682 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:19.131994 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:19.137974 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:19.138471 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:19.139232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:19.139672 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:19.271815 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:19.279620 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bb33f152-05fa-4364-b42d-62cfa49da0fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153120 May 05 14:27:19.280191 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1726/3145] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:20.148076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:20.148681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:20.154963 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:20.155440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:20.156242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:20.156675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:20.455212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:20.455212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2fba8b66-9c79-4311-8826-8e654ad28b65 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1682 microversion: 2.1 time: 0.148817 May 05 14:27:20.455212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1420/3146] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:20 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:20.456547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:20.456547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:20.456547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:20.456547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:20.457622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:20.457622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:20.457622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:20.457917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f175e9b3-ae6d-4d87-975b-d8717f791500 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148551 May 05 14:27:20.457917 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1727/3147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:21.311142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:21.311695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:21.322397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:21.322397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:21.322397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:21.322397 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:21.386091 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:21.393516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-be86408b-bbad-466a-b260-2fbe3b0954a2 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1615 microversion: 2.1 time: 0.086376 May 05 14:27:21.394122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1421/3148] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:21 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:21.459192 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:21.460399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:21.466791 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:21.467244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:21.468004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:21.468441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:21.606906 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:21.615342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75a1e215-ac61-4a15-9930-3e03f95c74d1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.159778 May 05 14:27:21.626896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1728/3149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:21.663659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-abe9ea23-2071-4c84-9a40-c197cd56cb1c req-66b2326f-07b1-47cf-856b-136f104f4ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7dcc206-30ae-4507-a017-691404eef1bc", "name": "network-vif-deleted", "tag": "92faf560-127a-4ed6-b84f-ea8ab273fe1e"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:21.664834 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-abe9ea23-2071-4c84-9a40-c197cd56cb1c req-66b2326f-07b1-47cf-856b-136f104f4ac0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:21.665287 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-abe9ea23-2071-4c84-9a40-c197cd56cb1c req-66b2326f-07b1-47cf-856b-136f104f4ac0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:21.676809 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-abe9ea23-2071-4c84-9a40-c197cd56cb1c req-66b2326f-07b1-47cf-856b-136f104f4ac0 service nova] Creating event network-vif-deleted:92faf560-127a-4ed6-b84f-ea8ab273fe1e for instance a7dcc206-30ae-4507-a017-691404eef1bc on hv-cinder-73761 May 05 14:27:21.682692 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-abe9ea23-2071-4c84-9a40-c197cd56cb1c req-66b2326f-07b1-47cf-856b-136f104f4ac0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100088 May 05 14:27:21.683311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1422/3150] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:27:22.411063 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:22.411689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:22.418253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:22.418708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:22.419491 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:22.419925 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:22.459571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:22.459571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:22.459571 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lazy-loading 'fault' on Instance uuid a7dcc206-30ae-4507-a017-691404eef1bc {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:27:22.502100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:22.510099 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-83007cb5-8d70-46b5-affc-8f19007eae40 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 200 len: 1331 microversion: 2.1 time: 0.102995 May 05 14:27:22.510673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1729/3151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:22 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:22.635106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:22.635813 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:22.642048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:22.642531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:22.643595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:22.644223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:22.776504 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:22.784388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3da98519-355e-406c-8b27-ed7f2c421474 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154085 May 05 14:27:22.784966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1423/3152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:23.528124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:23.528750 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:23.535124 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:23.535585 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:23.536357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:23.536802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:23.550632 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. May 05 14:27:23.551215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:27:23.552035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-38e7cb69-c6e2-41e1-8dc6-9fa9264733a0 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 404 len: 111 microversion: 2.1 time: 0.027844 May 05 14:27:23.552551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1730/3153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:23 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:27:23.561349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-411f451c-48d5-4313-828e-5763d55d244c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '.version_select at 0x7fb4e80c9940>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:23.688322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-411f451c-48d5-4313-828e-5763d55d244c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313916697" status: 202 len: 0 microversion: 2.1 time: 0.130556 May 05 14:27:23.688976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1424/3154] 10.222.0.26 () {58 vars in 1217 bytes} [Thu May 5 14:27:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313916697 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:27:23.800833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:23.801452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:23.807606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:23.810146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:23.810146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:23.810146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:23.965725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:23.974199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fbd41f29-834d-4601-9fac-76f9848a67f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.177271 May 05 14:27:23.974785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1731/3155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:24.470264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: .version_select at 0x7fb4e8108790>, body: {"keypair": {"name": "tempest-keypair-1659862732"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:24.486701 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:27:24.490523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:27:24.921986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:27:24.925656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:27:24.938265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3f59f287-5cb1-4059-aedc-436218479bdc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.471970 May 05 14:27:24.938861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1425/3156] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 14:27:24 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:24.992823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:24.993441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:24.999760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:25.000215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:25.000989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:25.001438 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:25.169030 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:25.176836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a7029d2f-9c0c-4b7f-bfb4-cf44cb93e299 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.188008 May 05 14:27:25.177343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1732/3157] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:26.194162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:26.194782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:26.200788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:26.201241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:26.202009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:26.202476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:26.329426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:26.337723 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-baae07c1-7c32-49ff-93ce-f0079fac0581 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147958 May 05 14:27:26.338288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1426/3158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:26 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:27.009634 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-67932", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "174b3825-61b6-4e7e-9ac6-6071af022321"}], "security_groups": [{"name": "tempest-securitygroup--1684251921"}], "key_name": "tempest-keypair-1659862732", "user_data": "}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:27.108643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] validate_networks() for [('174b3825-61b6-4e7e-9ac6-6071af022321', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:27:27.355162 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:27.355880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:27.362832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:27.363358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:27.364242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:27.364684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:27.830547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:27.838794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-371f0e16-c23d-48c3-943a-f3379ea79ace tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.487480 May 05 14:27:27.839360 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1427/3159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:27.856193 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:27:27.856623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:27:27.857107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:27:27.857525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:27:27.857944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:27:27.866944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:27.867397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:27.868209 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:27.868648 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:27.885548 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:27:27.889572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:27:27.901144 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:27:27.903457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:27:28.028423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-082c59fd-c376-4336-b1ed-8eff489ea019 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.023678 May 05 14:27:28.029365 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1733/3160] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 14:27:28.039341 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-99ceed9c-2971-4ace-856c-5e12a0a2a705 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:28.040015 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-99ceed9c-2971-4ace-856c-5e12a0a2a705 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:28.094797 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-99ceed9c-2971-4ace-856c-5e12a0a2a705 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:28.101711 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-99ceed9c-2971-4ace-856c-5e12a0a2a705 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1237 microversion: 2.1 time: 0.066391 May 05 14:27:28.102625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1428/3161] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:28 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:28.855883 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:28.856551 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:28.863615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:28.864082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:28.864823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:28.865256 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:28.999557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:29.007712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a2504150-2af5-4251-b4e5-c501077b4b1c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155672 May 05 14:27:29.008282 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1734/3162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:29.118842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:29.119583 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:29.126613 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:29.127159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:29.128017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:29.128534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:29.187821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:29.195150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-63d1c109-bb25-4017-9d18-5cc2b28aeae8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1233 microversion: 2.1 time: 0.080161 May 05 14:27:29.195722 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1429/3163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:29 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1233 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:30.024947 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:30.025709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:30.032348 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:30.034476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:30.034476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:30.034476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:30.168674 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:30.176665 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6c17b3ae-5f74-4534-9bb4-a750c9e47374 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155650 May 05 14:27:30.177228 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1735/3164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:30.211358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:30.212139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:30.218628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:30.219151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:30.219921 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:30.220468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:30.281234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:30.289299 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f5d112e4-2c32-4768-ba3d-05d51d37bb94 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1295 microversion: 2.1 time: 0.081770 May 05 14:27:30.289871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1430/3165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:30 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:31.194433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:31.194990 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:31.201263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:31.201720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:31.202537 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:31.202984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:31.307868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:31.308475 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:31.316086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:31.316549 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:31.317331 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:31.317770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:31.347168 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:31.355186 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3fe62011-78a9-49f9-a8f0-6d06ae89dbba tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.165226 May 05 14:27:31.366313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1736/3166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:31.406827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-b7b0ce50-ccb5-48fd-b7ce-b9e795f44ea5 req-a75b25ee-99e0-4e0b-9954-617149ee6a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ad4cb-1146-4350-96be-fe67fe0595d7", "tag": "e1aacfae-37a2-408b-874b-adc92c3d2d23"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:31.438964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b7b0ce50-ccb5-48fd-b7ce-b9e795f44ea5 req-a75b25ee-99e0-4e0b-9954-617149ee6a1b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:31.439788 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b7b0ce50-ccb5-48fd-b7ce-b9e795f44ea5 req-a75b25ee-99e0-4e0b-9954-617149ee6a1b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:31.465651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:31.468500 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-b7b0ce50-ccb5-48fd-b7ce-b9e795f44ea5 req-a75b25ee-99e0-4e0b-9954-617149ee6a1b service nova] Creating event network-changed:e1aacfae-37a2-408b-874b-adc92c3d2d23 for instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 on hv-cinder-73761 May 05 14:27:31.471787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-b7b0ce50-ccb5-48fd-b7ce-b9e795f44ea5 req-a75b25ee-99e0-4e0b-9954-617149ee6a1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068977 May 05 14:27:31.472642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1737/3167] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:27:31.475832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ee377e0a-8859-459f-9911-d332a5757250 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.173280 May 05 14:27:31.476350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1431/3168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:31 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:32.374437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:32.375061 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:32.382112 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:32.382567 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:32.383324 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:32.383760 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:32.492695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:32.493593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:32.499986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:32.500512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:32.501347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:32.501791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:32.508113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:32.515950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4f21666-d0e7-43eb-aabd-16736b142114 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145820 May 05 14:27:32.516516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1738/3169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:32.627567 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:32.635365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-043249e4-bd17-4ecd-86ed-c3da5c62474c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.146567 May 05 14:27:32.635932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1432/3170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:32 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:33.533686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:33.534329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:33.541197 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:33.541644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:33.542431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:33.542867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:33.652742 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:33.653291 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:33.659573 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:33.660027 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:33.660802 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:33.661240 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:33.666952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:33.674941 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0b57624a-6b12-49f2-9340-b6e745ffaab4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145106 May 05 14:27:33.675506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1739/3171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:33 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:33.786343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:33.794206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a7615927-3176-4a3e-866e-43a324b4f74d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.145381 May 05 14:27:33.794788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1433/3172] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:33 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:34.692274 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:34.692891 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:34.699746 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:34.700195 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:34.700949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:34.701387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:34.811048 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:34.812300 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:34.819568 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:34.820018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:34.820783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:34.821409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:34.828869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:34.837386 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-629cd8b8-bc37-4cf9-9358-5978bf650298 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149001 May 05 14:27:34.838225 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1740/3173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:34.947805 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:34.955228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a2093724-05f4-4d8a-8a57-5912bc4ede32 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.148206 May 05 14:27:34.955786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1434/3174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:34 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:35.854950 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:35.855687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:35.862337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:35.862786 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:35.863545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:35.863982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:35.972875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:35.973602 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:35.980575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:35.981946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:35.981946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:35.982234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:35.992910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:36.000637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3a37fc42-46be-4e34-8623-2cd5b367488c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149513 May 05 14:27:36.001206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1741/3175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:36.108447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:36.116603 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a4c8ea38-49d9-4f62-ab64-abd4e130c930 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.147664 May 05 14:27:36.117161 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1435/3176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:35 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:36.989138 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-34b087ef-82fc-4fbd-a783-130cb60a0ce4 req-9c3fcfba-973b-4468-99d6-f24f58a6ed24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ad4cb-1146-4350-96be-fe67fe0595d7", "name": "network-vif-plugged", "status": "completed", "tag": "e1aacfae-37a2-408b-874b-adc92c3d2d23"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:36.998057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-34b087ef-82fc-4fbd-a783-130cb60a0ce4 req-9c3fcfba-973b-4468-99d6-f24f58a6ed24 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:36.998443 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-34b087ef-82fc-4fbd-a783-130cb60a0ce4 req-9c3fcfba-973b-4468-99d6-f24f58a6ed24 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:37.009700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-34b087ef-82fc-4fbd-a783-130cb60a0ce4 req-9c3fcfba-973b-4468-99d6-f24f58a6ed24 service nova] Creating event network-vif-plugged:e1aacfae-37a2-408b-874b-adc92c3d2d23 for instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 on hv-cinder-73761 May 05 14:27:37.014708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-34b087ef-82fc-4fbd-a783-130cb60a0ce4 req-9c3fcfba-973b-4468-99d6-f24f58a6ed24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029351 May 05 14:27:37.015473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1742/3177] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:27:37.017844 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:37.018491 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:37.025849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:37.026352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:37.027294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:37.027601 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:37.133875 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:37.134605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:37.141093 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:37.141542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:37.142333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:37.142771 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:37.159121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:37.167882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-639cfdf6-5d26-4b17-aa77-e92d0dce5920 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153995 May 05 14:27:37.171780 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1436/3178] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:37.277158 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:37.286460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-faa9632d-3333-4fcf-b062-61f0a8570d4d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.157401 May 05 14:27:37.287039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1743/3179] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:37 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:38.184737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:38.185365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:38.191808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:38.192256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:38.193006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:38.193471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:38.302727 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:38.303475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:38.309879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:38.310454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:38.311278 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:38.311802 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:38.320466 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:38.328379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-914b8faa-3c84-4ca1-af7e-42101d8c9ceb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147521 May 05 14:27:38.328945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1437/3180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:38.439529 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:38.447333 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-28e77d40-64ea-4449-b6cd-7ce0a118172e tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1363 microversion: 2.1 time: 0.148458 May 05 14:27:38.447894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1744/3181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:38 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:39.345704 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:39.346373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:39.352846 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.353303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.354124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.354576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.464534 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:39.465176 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:39.471296 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.471748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.472514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.472973 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.479769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:39.487899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7b37e8da-03bb-4a43-8407-46d782906f44 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146042 May 05 14:27:39.488465 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1438/3182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:39.599679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:39.606984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-65d34be5-11db-410f-9767-01f593bf2247 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1553 microversion: 2.1 time: 0.146302 May 05 14:27:39.607545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1745/3183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:39 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:39.623570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:39.624099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:39.629927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.630415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.631807 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:39.632228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:39.705709 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3742483c-3e06-423e-a5d9-fe042fcebbd6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085927 May 05 14:27:39.706371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1439/3184] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 14:27:39 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:27:40.509461 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:40.510119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:40.516573 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:40.517032 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:40.517810 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:40.518364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:40.719114 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:40.727429 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a4742b7e-4b27-493d-8cc7-60c6feaf2efe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.222601 May 05 14:27:40.728003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1746/3185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:40 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:40.778242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-b73b81a7-6ab6-4e10-b6c7-d36db061ceca req-faac17c8-e97a-451e-b602-34748295bb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec3ad4cb-1146-4350-96be-fe67fe0595d7", "tag": "e1aacfae-37a2-408b-874b-adc92c3d2d23"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:27:40.786256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b73b81a7-6ab6-4e10-b6c7-d36db061ceca req-faac17c8-e97a-451e-b602-34748295bb79 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:40.786697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b73b81a7-6ab6-4e10-b6c7-d36db061ceca req-faac17c8-e97a-451e-b602-34748295bb79 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:40.800074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-b73b81a7-6ab6-4e10-b6c7-d36db061ceca req-faac17c8-e97a-451e-b602-34748295bb79 service nova] Creating event network-changed:e1aacfae-37a2-408b-874b-adc92c3d2d23 for instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 on hv-cinder-73761 May 05 14:27:40.805770 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-b73b81a7-6ab6-4e10-b6c7-d36db061ceca req-faac17c8-e97a-451e-b602-34748295bb79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031665 May 05 14:27:40.806403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1440/3186] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:27:41.745277 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:41.746081 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:41.752826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:41.753284 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:41.754163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:41.754606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:41.884954 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:41.892778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9f90a615-982b-42bf-8d00-24ddca13d020 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151451 May 05 14:27:41.893345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1747/3187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:42.910608 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:42.911268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:42.917409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:42.917866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:42.918682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:42.919114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:43.047689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:43.055576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b16894c4-46ce-44d2-b831-9235d2a32778 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149787 May 05 14:27:43.056136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1441/3188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:44.073363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:44.073897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:44.080269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:44.080730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:44.081494 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:44.081934 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:44.213405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:44.221521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bd4d0bdf-97ce-42b7-92d5-6150c90025ae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.152726 May 05 14:27:44.222116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1748/3189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:45.239407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:45.240014 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:45.247239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:45.247691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:45.248440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:45.248872 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:45.372233 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:45.380079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c74086b1-89a6-46c1-8931-83cb5f359bd8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144528 May 05 14:27:45.380642 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1442/3190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:46.396885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:46.397514 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:46.403991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:46.404440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:46.405206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:46.405643 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:46.536310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:46.544211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-39edb475-e0df-4bd3-9ec1-ea986190c99d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151240 May 05 14:27:46.544818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1749/3191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:46 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:47.561565 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:47.562229 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:47.568518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:47.568966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:47.569717 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:47.570225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:47.694276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:47.702056 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe9dd579-beae-4328-aaf8-da19a90de31f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144322 May 05 14:27:47.702625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1443/3192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:48.719630 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:48.720325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:48.727267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:48.727720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:48.728484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:48.728926 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:48.861535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:48.869411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f6fc7311-680f-4ac5-bc78-0f8fd25ce3c4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153646 May 05 14:27:48.869980 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1750/3193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:49.885977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:49.886620 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:49.892672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:49.893124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:49.893885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:49.894359 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:50.021546 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:50.029847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-0791126b-a247-4488-afe7-999908836936 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147768 May 05 14:27:50.030440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1444/3194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:51.047531 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:51.048153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:51.055207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:51.055667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:51.056433 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:51.056876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:51.193269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:51.202450 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-80cfeae7-60ad-42b5-95a9-734287106957 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.158684 May 05 14:27:51.203105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1751/3195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:52.220672 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:52.221213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:52.228139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:52.228589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:52.229446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:52.229879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:52.357452 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:52.365580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1ebd2419-600b-471e-b982-1dfd3b2770bb tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148781 May 05 14:27:52.366175 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1445/3196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:53.383064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:53.383611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:53.389910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:53.390388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:53.391154 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:53.391843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:53.524452 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:53.532255 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9831a1e3-5ddf-46bf-a338-e51a905285f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.153121 May 05 14:27:53.532830 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1752/3197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:53 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:27:54.550074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:54.550622 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:54.556994 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:54.557445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:54.558245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:54.558684 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:54.680628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:54.688311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-43376e49-1171-4a35-b129-f7e5bc325f26 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.142198 May 05 14:27:54.688885 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1446/3198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:55.706327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:55.706895 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:55.713300 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:55.713754 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:55.714547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:55.714992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:55.841477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:55.849235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cb0bfc98-abce-4937-9252-223b98ba318e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146857 May 05 14:27:55.849801 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1753/3199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:56.867186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:56.867801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:56.874123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:56.874576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:56.875338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:56.875779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:57.006384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:57.015024 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8b0b39e2-d469-4508-9094-687d22e6ebec tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151795 May 05 14:27:57.015610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1447/3200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:58.032758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:58.033379 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:58.039552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:58.040001 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:58.040752 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:58.041185 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:58.172435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:58.180770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8baa5956-b1f9-457a-a696-2ddb6f1532f8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.152017 May 05 14:27:58.181334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1754/3201] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:27:59.198042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:27:59.198678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:27:59.205067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:59.205522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:59.206324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:27:59.206766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:27:59.330884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:27:59.339495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3a6684d8-1cf9-4b89-94b5-e353d3009bae tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145412 May 05 14:27:59.340079 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1448/3202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:27:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:00.357364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:00.357912 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:00.364694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:00.365151 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:00.365918 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:00.366388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:00.494888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:00.502658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a2aef22-193d-49af-8436-287a7ee25afa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149358 May 05 14:28:00.503230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1755/3203] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:00 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:01.519798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:01.520384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:01.527438 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:01.527882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:01.528640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:01.529074 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:01.668303 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:01.676075 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6c8e3fae-5df2-4e38-9408-46608fbcc949 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.160146 May 05 14:28:01.676663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1449/3204] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:02.693226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:02.693841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:02.700731 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:02.701180 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:02.701940 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:02.702406 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:02.825894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:02.834065 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-141060f9-7fb7-4272-be95-9a1969102e7c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144669 May 05 14:28:02.834677 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1756/3205] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:03.851825 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:03.853298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:03.861386 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:03.862104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:03.862879 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:03.863358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:03.990727 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:03.999159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df6f0386-e36d-4535-9049-c81aff7f52a9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151778 May 05 14:28:03.999724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1450/3206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:05.015880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:05.016496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:05.022868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:05.023317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:05.024104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:05.024541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:05.151206 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:05.163141 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9ca52de7-0fb9-44d9-9f49-5f6c835600c2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149083 May 05 14:28:05.163737 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1757/3207] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:06.180615 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:06.181790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:06.188211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:06.188665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:06.189429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:06.189871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:06.318276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:06.326180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-83f1a20b-4dab-4e9c-b9c5-61015698e18a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149491 May 05 14:28:06.326750 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1451/3208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:07.343955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:07.344577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:07.351053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:07.351562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:07.352430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:07.353345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:07.481051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:07.489079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1b8f4bc8-1a08-4138-9c08-060bd0dd12a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149031 May 05 14:28:07.489642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1758/3209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:08.506383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:08.506942 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:08.513337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:08.513791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:08.514582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:08.515023 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:08.638168 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:08.645886 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-855a9496-c50b-4e91-bba2-176cd735b099 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143508 May 05 14:28:08.646580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1452/3210] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:08 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:09.663794 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:09.664346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:09.671327 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:09.671787 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:09.672555 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:09.673000 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:09.798547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:09.806364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-62efcc5a-e929-46b8-8fef-f6bcd334dd05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146536 May 05 14:28:09.806932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1759/3211] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:10.365713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:10.366296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:10.372665 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:10.373108 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:10.373860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:10.374324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:10.398839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ec8ebd52-93d9-48ec-ab28-03a6f54687a5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.036971 May 05 14:28:10.399903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1453/3212] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 14:28:10 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:28:10.824094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:10.824635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:10.830977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:10.831431 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:10.832194 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:10.832637 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:10.956320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:10.964169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4fd11ff9-a95a-4638-9585-0ddf9cba14f6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144583 May 05 14:28:10.967613 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1760/3213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:11.981551 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:11.982213 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:11.988824 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:11.989269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:11.990049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:11.990477 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:12.119483 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:12.127344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-69269630-4b80-4f7c-b33d-ed876c10f62c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149577 May 05 14:28:12.127909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1454/3214] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:13.145253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:13.145873 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:13.152861 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:13.153314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:13.154106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:13.154550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:13.277541 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:13.285290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-259a2ea3-dbe9-48fd-8c35-159cdd0ccc37 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144026 May 05 14:28:13.285851 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1761/3215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:14.302758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:14.303390 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:14.309680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:14.310171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:14.310932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:14.311368 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:14.437180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:14.445018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b13a09ad-4d7b-48e5-8ed5-cae6481d27a2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146268 May 05 14:28:14.445582 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1455/3216] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:15.462989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:15.463606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:15.469969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:15.470455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:15.471262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:15.471704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:15.599003 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:15.607416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fae92581-c60f-4677-9a86-09a276342ed1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148781 May 05 14:28:15.607983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1762/3217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:15 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:16.624975 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:16.625590 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:16.631945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:16.632391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:16.633142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:16.633571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:16.757843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:16.765683 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-48e213a3-e01d-4a42-88b2-61e6bec7ffe2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144570 May 05 14:28:16.766526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1456/3218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:17.782993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:17.783578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:17.789838 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:17.790319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:17.791133 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:17.791574 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:17.929896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:17.938156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9082ced5-a4e7-482b-b38b-a619612bb6b8 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.159084 May 05 14:28:17.945542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1763/3219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:18.956003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:18.956606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:18.962988 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:18.963469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:18.964297 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:18.964766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:19.087801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:19.096154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2a42c794-29e5-407d-a44b-c55109cb97c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144059 May 05 14:28:19.096725 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1457/3220] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:20.114217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:20.114833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:20.121149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:20.121602 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:20.122390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:20.122831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:20.247302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:20.255045 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-81d69192-60f5-4aee-b5a6-7dfdb95be0fd tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144729 May 05 14:28:20.255603 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1764/3221] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:20 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:21.272490 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:21.273102 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:21.279154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:21.279598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:21.280350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:21.280783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:21.403792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:21.412311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-02daaad2-288a-487f-a4e3-fd7afb56c408 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143802 May 05 14:28:21.412866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1458/3222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:21 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:22.430115 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:22.430707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:22.437522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:22.437970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:22.438751 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:22.439184 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:22.563501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:22.571281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-24c2193d-b36a-4bfc-90f3-575c705b175e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145150 May 05 14:28:22.571844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1765/3223] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:22 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:23.587776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:23.588991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:23.595329 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:23.595776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:23.596773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:23.597371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:23.724409 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:23.732338 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-39a89bbb-20a2-4f8d-be26-3ab468abee05 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148532 May 05 14:28:23.732905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1459/3224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:23 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:24.750371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:24.751010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:24.757449 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:24.757901 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:24.758690 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:24.759128 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:24.882916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:24.890707 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9317275d-fca4-4879-aba3-42e76ef7ab34 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144178 May 05 14:28:24.891273 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1766/3225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:24 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:25.908148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:25.908758 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:25.915126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:25.915574 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:25.916964 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:25.917398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:26.046376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:26.054101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-13f79598-f090-4823-b85c-406268faefb6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149848 May 05 14:28:26.054675 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1460/3226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:25 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:27.071293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:27.071953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:27.078767 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:27.079229 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:27.079995 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:27.080435 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:27.205420 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:27.213725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1e4c2ea0-bac6-4c59-970e-861ee7a653e2 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145808 May 05 14:28:27.214316 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1767/3227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:27 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:28.231069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:28.231681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:28.238468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:28.238915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:28.243724 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:28.244871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:28.373499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:28.381395 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8f1bbbca-9760-430d-8a0f-0f3979b4944f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154227 May 05 14:28:28.381946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1461/3228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:28 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:29.399687 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:29.400222 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:29.406718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:29.407169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:29.407922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:29.408359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:29.530623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:29.538399 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-02763692-c800-4ff2-95a1-00409f9106e6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.142774 May 05 14:28:29.538964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1768/3229] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:29 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:30.556393 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:30.556980 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:30.563334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:30.563782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:30.564530 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:30.564976 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:30.688482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:30.696275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3266df0d-241f-4f62-9fae-605a78f99fd3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143928 May 05 14:28:30.696832 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1462/3230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:30 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:31.713347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:31.713888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:31.720318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:31.720770 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:31.721522 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:31.721956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:31.855060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:31.863813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-d4fe3c70-4670-4b87-9dd8-4de110d4a1f9 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.154367 May 05 14:28:31.864381 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1769/3231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:31 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:32.880145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:32.880751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:32.887897 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:32.888356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:32.889124 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:32.889570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:33.014681 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:33.022600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-86ef569c-972c-49bb-a82d-e4fa03276e67 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146362 May 05 14:28:33.023172 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1463/3232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:32 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:34.040002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:34.040647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:34.046998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:34.047444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:34.048198 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:34.048635 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:34.176040 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:34.184235 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-27f76499-1d78-4e8f-9d19-81ebd33d5e74 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148154 May 05 14:28:34.184795 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1770/3233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:34 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:35.201209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:35.201821 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:35.208219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:35.208700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:35.209455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:35.209889 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:35.332633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:35.340440 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1e8af45-e8cb-4ddd-8063-6b0368658912 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143048 May 05 14:28:35.340998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1464/3234] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:35 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:36.356944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:36.357528 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:36.364257 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:36.364711 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:36.365479 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:36.365920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:36.496985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:36.504796 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7106b5eb-c7b9-468a-b4e4-87e826abdd53 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151959 May 05 14:28:36.505357 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1771/3235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:36 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:37.523938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:37.524554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:37.531581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:37.532032 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:37.532817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:37.533275 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:37.660234 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:37.668232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e11cd10b-6e08-41db-8fe5-cc425881199a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148130 May 05 14:28:37.668740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1465/3236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:37 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:38.684530 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:38.685145 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:38.691536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:38.691986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:38.692749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:38.693188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:38.815708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:38.823474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dde1e6d5-4e7d-469a-81d0-1cd035efab8a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.142885 May 05 14:28:38.824039 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1772/3237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:38 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:39.839965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:39.840577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:39.846943 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:39.847407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:39.848158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:39.848591 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:40.231764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:40.239839 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-81c199ee-bf73-4063-a076-162158cda594 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.403786 May 05 14:28:40.240407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1466/3238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:39 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:41.256758 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:41.257380 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:41.263825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:41.264281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:41.265051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:41.265518 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:41.388962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:41.396689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4ff5b16c-accc-478e-8542-243d66b6451a tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.143889 May 05 14:28:41.397250 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1773/3239] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:41 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:42.414543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:42.415111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:42.421508 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:42.421960 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:42.422765 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:42.423200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:42.549069 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:42.556817 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1b582045-b9a9-4b5e-b00e-5ac449e468e7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146225 May 05 14:28:42.557884 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1467/3240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:42 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:43.575368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:43.575977 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:43.582513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:43.582968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:43.583730 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:43.584174 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:43.719807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:43.727793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b7f91f89-c5e1-4197-85e7-47549184c5ab tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.156798 May 05 14:28:43.728354 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1774/3241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:43 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:44.745243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:44.745791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:44.752853 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:44.753351 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:44.754220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:44.754668 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:44.879363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:44.888332 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-e8659a3d-adc9-43c0-964c-42c10863d458 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147503 May 05 14:28:44.888911 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1468/3242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:44 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:45.905568 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:45.906247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:45.912617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:45.913072 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:45.913836 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:45.914310 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:46.041694 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:46.049405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-fed25190-a9ce-420d-a8c7-3e472ac090f1 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147744 May 05 14:28:46.049968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1775/3243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:45 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:47.067312 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:47.067947 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:47.074982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:47.076073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:47.076200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:47.076626 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:47.207298 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:47.215198 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3c8c6bb8-df37-486d-b756-1b3b6743237d tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151775 May 05 14:28:47.215776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1469/3244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:47 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:48.232807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:48.233416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:48.239982 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:48.240426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:48.241363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:48.241805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:48.370476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:48.379199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5ef94bda-5182-449f-a4f4-6ebc11c17606 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150085 May 05 14:28:48.379763 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1776/3245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:48 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:49.397204 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:49.439607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:49.439607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:49.439607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:49.439607 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:49.440903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:49.529977 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:49.537721 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6fc280f5-7cd5-4f19-8016-4e04e83f3397 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144567 May 05 14:28:49.538388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1470/3246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:49 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:50.554920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:50.555477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:50.561766 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:50.562260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:50.563033 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:50.563473 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:50.690374 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:50.698952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-426acd1a-b747-4cd7-8214-7da84199fda6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.147942 May 05 14:28:50.699521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1777/3247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:50 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:51.716398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:51.716957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:51.723339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:51.723792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:51.724569 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:51.724997 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:51.849350 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:51.857112 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-3c0bede8-3530-49e0-8502-f0f5108e4a3f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144703 May 05 14:28:51.857682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1471/3248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:51 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:52.875060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:52.875745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:52.882304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:52.882757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:52.883544 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:52.883989 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:53.012244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:53.020200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-36fb71d2-abdf-441f-b7c3-557629e18b33 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148939 May 05 14:28:53.021007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1778/3249] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:52 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:54.038126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:54.038731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:54.045638 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:54.046126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:54.046905 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:54.047365 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:54.176791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:54.185186 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2802e651-2710-4449-8a77-5a6a539dc1c7 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151014 May 05 14:28:54.185785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1472/3250] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:54 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:55.202907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:55.203524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:55.209956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:55.210446 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:55.211218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:55.211660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:55.335460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:55.343268 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-dc12401b-1415-4902-881f-0f884a705ec3 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144204 May 05 14:28:55.343833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1779/3251] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:55 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:56.361010 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:56.361554 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:56.367883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:56.371428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:56.371428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:56.371428 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:56.499328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:56.507276 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b2fd2bf7-584a-4cf4-a49e-232ead41c304 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150548 May 05 14:28:56.507833 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1473/3252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:56 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:57.525217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:57.525843 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:57.532641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:57.533094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:57.533876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:57.534344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:57.661700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:57.670152 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7db29990-6558-44ae-95c4-99234888866e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148818 May 05 14:28:57.670718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1780/3253] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:57 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:58.687429 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:58.688051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:58.694563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:58.695021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:58.695791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:58.696235 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:58.820865 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:58.828740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-026df71f-d583-444c-960d-39c6e3006817 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145265 May 05 14:28:58.829311 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1474/3254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:58 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:28:59.845984 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:28:59.846617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:28:59.852542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:59.852992 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:59.853748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:28:59.854216 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:28:59.980852 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:28:59.988799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c29683c8-907a-4974-aec6-ac9bcd7fef8e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.146816 May 05 14:28:59.989363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1781/3255] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:28:59 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:01.006640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:01.007413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:01.013922 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:01.014415 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:01.015183 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:01.015625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:01.139474 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:01.147245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-22d8cd82-1db5-43de-99a7-1bb10981fc60 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144487 May 05 14:29:01.147798 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1475/3256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:01 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:02.165035 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:02.165644 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:02.172813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:02.173267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:02.174116 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:02.174552 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:02.303015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:02.310870 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e2ed3910-5ed6-44b5-96a0-24f9528bb303 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149646 May 05 14:29:02.311437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1782/3257] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:02 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:03.328177 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:03.328785 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:03.335147 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:03.335595 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:03.336356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:03.336788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:03.461143 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:03.469447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-aecbf8f3-7285-4d75-bdd0-f1be30911102 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.145167 May 05 14:29:03.469999 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1476/3258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:03 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:04.491497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:04.492053 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:04.499565 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:04.500010 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:04.500777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:04.501211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:04.629011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:04.636704 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-bc43076f-4ad2-49da-a543-9afdfa4d504f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149128 May 05 14:29:04.637262 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1783/3259] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:04 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:29:05.655594 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:05.656202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:05.662667 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:05.663116 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:05.663869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:05.664308 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:05.788450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:05.796296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8812929c-cdb5-4d4d-b174-9a57145c20c6 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144562 May 05 14:29:05.796861 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1477/3260] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:05 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:06.818680 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:06.819302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:06.826217 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:06.826675 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:06.827447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:06.827890 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:06.956859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:06.964664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0ff1fd7f-aa30-4158-9eef-a2723948c78e tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149951 May 05 14:29:06.965227 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1784/3261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:06 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:07.982924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:07.983468 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:07.990196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:07.990652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:07.994925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:07.994925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:08.122880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:08.130706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da225a4e-aa58-4146-aa92-8665b5adc626 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.151772 May 05 14:29:08.131280 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1478/3262] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:07 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:09.148682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:09.149339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:09.155790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:09.156247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:09.157012 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:09.157455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:09.281119 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:09.288963 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7d8cbcb8-b057-4e4b-b29f-6c9d300e3726 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.144114 May 05 14:29:09.289469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1785/3263] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:09 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:10.305938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:10.306584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:10.313426 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.313882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.314678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.315126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.447570 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:10.451494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f956d1e3-7027-4d48-b8b5-6bb17074bbd0 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149422 May 05 14:29:10.452059 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1479/3264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:10 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:10.470584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:10.471094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:10.477447 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.477908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.478739 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.479182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.505469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:29:10.758362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f4dfcd11-191f-4115-bf7a-416cdcf0b4a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 204 len: 0 microversion: 2.1 time: 0.291193 May 05 14:29:10.758864 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1786/3265] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:29:10 2022] DELETE /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:29:10.767038 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:10.767679 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:10.773755 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.774771 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.775058 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:10.775494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:10.900106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:10.908106 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d327d533-93cc-406e-a790-3bd02a7798e6 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1678 microversion: 2.1 time: 0.144872 May 05 14:29:10.908666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1480/3266] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:10 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:29:11.469825 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:11.470556 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:11.476834 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:11.477384 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:11.478084 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:11.478526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:11.606892 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:11.615019 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef1b4f46-bca5-47cc-b394-15b0446b04e4 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.150033 May 05 14:29:11.615588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1787/3267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:11 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:11.929677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:11.930328 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:11.938185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:11.938647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:11.939433 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:11.939871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:12.068021 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:12.075290 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-df5657fd-6e74-4b22-9f8b-432f93035871 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1678 microversion: 2.1 time: 0.149554 May 05 14:29:12.075851 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1481/3268] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:11 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:12.632753 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:12.633371 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:12.640201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:12.640666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:12.641524 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:12.641967 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:12.775506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:12.784623 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1541d5aa-a951-4a31-8976-9e4e7a5f403f tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.155663 May 05 14:29:12.785211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1788/3269] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:13.092432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:13.093489 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:13.105243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:13.105919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:13.106790 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:13.107237 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:13.174902 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:13.183739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b29b48df-dada-490b-b8b8-09b38273c6c7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1610 microversion: 2.1 time: 0.095038 May 05 14:29:13.195520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1482/3270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:13 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1610 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:13.235026 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-06153b9a-5ce0-44fc-91a4-300de0d8c889 req-d52d1fca-434c-4bbe-be21-c8f51dca5845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec3ad4cb-1146-4350-96be-fe67fe0595d7", "name": "network-vif-deleted", "tag": "e1aacfae-37a2-408b-874b-adc92c3d2d23"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:13.242986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-06153b9a-5ce0-44fc-91a4-300de0d8c889 req-d52d1fca-434c-4bbe-be21-c8f51dca5845 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:13.245428 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-06153b9a-5ce0-44fc-91a4-300de0d8c889 req-d52d1fca-434c-4bbe-be21-c8f51dca5845 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:13.258468 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-06153b9a-5ce0-44fc-91a4-300de0d8c889 req-d52d1fca-434c-4bbe-be21-c8f51dca5845 service nova] Creating event network-vif-deleted:e1aacfae-37a2-408b-874b-adc92c3d2d23 for instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 on hv-cinder-73761 May 05 14:29:13.264029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-06153b9a-5ce0-44fc-91a4-300de0d8c889 req-d52d1fca-434c-4bbe-be21-c8f51dca5845 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 May 05 14:29:13.264740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1789/3271] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:29:13.803478 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:13.804510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:13.811163 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:13.811617 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:13.824593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:13.824593 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:13.949090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:13.957096 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7e6ba6de-4269-4cae-b2da-103f231e18a5 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.158428 May 05 14:29:13.957663 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1483/3272] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:14.203363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:14.204387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:14.214414 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:14.214823 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:14.215586 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:14.216840 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:14.255619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:14.256535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:14.257181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lazy-loading 'fault' on Instance uuid ec3ad4cb-1146-4350-96be-fe67fe0595d7 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:29:14.302610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:14.311074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cab57ca0-6579-42ac-afd5-8a64a2f62c47 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 200 len: 1327 microversion: 2.1 time: 0.113473 May 05 14:29:14.311652 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1790/3273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:14 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:14.975202 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:14.975883 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:14.982970 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:14.983434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:14.984208 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:14.984915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:15.112923 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:15.120838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-63f26812-51e5-4c7a-9784-7649eec4001c tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.149605 May 05 14:29:15.121407 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1484/3274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:14 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:29:15.331459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:15.332082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:15.338416 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:15.338896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:15.339659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:15.340095 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:15.353484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. May 05 14:29:15.354083 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:29:15.354894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a5983c5a-7364-4c09-9cf9-023047fc9345 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 404 len: 111 microversion: 2.1 time: 0.027232 May 05 14:29:15.355400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1791/3275] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:15 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:29:15.364418 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-25b9bb16-ef8f-41d0-8297-f71489d3c346 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '.version_select at 0x7fb4ec217c10>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:15.456411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-25b9bb16-ef8f-41d0-8297-f71489d3c346 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659862732" status: 202 len: 0 microversion: 2.1 time: 0.095725 May 05 14:29:15.457097 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1485/3276] 10.222.0.26 () {58 vars in 1220 bytes} [Thu May 5 14:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659862732 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:29:16.139002 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:16.139615 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:16.145512 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:16.145962 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:16.146803 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:16.147205 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:16.238779 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: .version_select at 0x7fb4e81fc700>, body: {"keypair": {"name": "tempest-keypair-363000474"}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:16.253650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:29:16.257695 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:29:16.291488 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:16.299985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9526364b-ee9a-48bc-89f9-0ff1c68926fa tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.164960 May 05 14:29:16.300547 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1792/3277] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:16 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:16.472088 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:29:16.475614 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'key_pairs'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:29:16.488606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d9d66dc1-5747-41b6-a0e8-bba31e893fab tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.255334 May 05 14:29:16.489200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1486/3278] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 14:29:16 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:17.316725 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:17.317345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:17.323777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:17.324213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:17.324986 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:17.325430 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:17.469469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:17.477415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2c28d35d-ba02-41ac-b2cc-eb2b4ee12dbe tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.164634 May 05 14:29:17.479983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1793/3279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:17 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:18.495575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:18.496228 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:18.502651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:18.503099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:18.503860 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:18.504296 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:18.554474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1986020893", "imageRef": "f300ff67-be04-425c-a78a-fae43e6f1984", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "174b3825-61b6-4e7e-9ac6-6071af022321"}], "security_groups": [{"name": "tempest-securitygroup--353067557"}], "key_name": "tempest-keypair-363000474", "user_data": "}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:18.664035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:18.672020 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c187ae45-6788-42d8-a19a-3784e5137218 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.180397 May 05 14:29:18.672781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1487/3280] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:18 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:29:18.679499 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] validate_networks() for [('174b3825-61b6-4e7e-9ac6-6071af022321', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:29:19.032907 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:29:19.033271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:29:19.033747 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:29:19.034188 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:29:19.034601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:29:19.043269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:19.043716 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:19.044508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:19.044942 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:19.061696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:29:19.065601 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Getting quotas for user 795830eaa7be4737a520a63d3801e2f3 and project 8fc1b60b8b0d4479970f34e29312783f. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:29:19.076920 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:29:19.079163 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f300ff67-be04-425c-a78a-fae43e6f1984',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:29:19.188577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-284a2394-3cf6-4493-adf5-0b5adbe657a9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.638374 May 05 14:29:19.189218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1794/3281] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:29:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 05 14:29:19.199019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6cd933ed-bb67-487f-acb9-99fbfd7f2502 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:19.199634 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6cd933ed-bb67-487f-acb9-99fbfd7f2502 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:19.251444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6cd933ed-bb67-487f-acb9-99fbfd7f2502 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:19.260333 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6cd933ed-bb67-487f-acb9-99fbfd7f2502 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1241 microversion: 2.1 time: 0.064895 May 05 14:29:19.261030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1488/3282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:19 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:19.689817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:19.690497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:19.697362 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:19.699490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:19.699490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:19.699490 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:19.826276 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:19.834187 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-75e9ad10-fb31-478c-a67e-6e2d2a8ce596 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1721 microversion: 2.1 time: 0.148705 May 05 14:29:19.834778 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1795/3283] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:19 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:19.851578 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2ee551db-8bec-43fe-8c90-04f0f5303f08 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '.version_select at 0x7fb4e81f3160>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:19.917089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2ee551db-8bec-43fe-8c90-04f0f5303f08 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679087716" status: 202 len: 0 microversion: 2.1 time: 0.069287 May 05 14:29:19.917598 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1489/3284] 10.222.0.26 () {58 vars in 1220 bytes} [Thu May 5 14:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679087716 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 05 14:29:20.283297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:20.283916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:20.289953 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:20.290436 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:20.291390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:20.291833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:20.372153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:20.379550 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cab24d09-72b7-465d-a3b7-d1453bcdd0b9 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1237 microversion: 2.1 time: 0.100330 May 05 14:29:20.380123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1796/3285] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:20 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:20.898294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-7e59cd06-62d7-4011-8c20-5ec9b17776f2 req-094bfdb7-497e-46ef-a24a-e4224ea1114c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a900c1d4-5ad8-4465-9f93-b1263bd89f66", "tag": "9552713a-7887-402b-80fe-83abd608be5c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:20.909847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-7e59cd06-62d7-4011-8c20-5ec9b17776f2 req-094bfdb7-497e-46ef-a24a-e4224ea1114c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:20.910356 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-7e59cd06-62d7-4011-8c20-5ec9b17776f2 req-094bfdb7-497e-46ef-a24a-e4224ea1114c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:20.921691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-7e59cd06-62d7-4011-8c20-5ec9b17776f2 req-094bfdb7-497e-46ef-a24a-e4224ea1114c service nova] Creating event network-changed:9552713a-7887-402b-80fe-83abd608be5c for instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 on hv-cinder-73761 May 05 14:29:20.927959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-7e59cd06-62d7-4011-8c20-5ec9b17776f2 req-094bfdb7-497e-46ef-a24a-e4224ea1114c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036051 May 05 14:29:20.928373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1490/3286] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:29:21.397153 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:21.398281 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:21.410267 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:21.410738 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:21.411532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:21.411983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:21.495368 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:21.508520 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9a367329-d565-44bf-be00-11a888d35f9c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1299 microversion: 2.1 time: 0.114480 May 05 14:29:21.509896 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1797/3287] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:21 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:22.531687 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:22.532419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:22.539284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:22.539735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:22.540510 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:22.540996 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:22.717715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:22.724919 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8c17232f-2ab8-48a9-9bcc-acbb2a23f0c8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.197999 May 05 14:29:22.725482 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1491/3288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:22 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:23.093993 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-b8d856c1-c869-4119-aceb-1ba87898f59f req-14a493ca-3d8a-4be4-bde2-6738fdfc79d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "809bf278-643f-4007-ab59-2b2134e4bfb9", "tag": "7f449cbb-3372-41f5-95a8-c06ed623f20f"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:23.103743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b8d856c1-c869-4119-aceb-1ba87898f59f req-14a493ca-3d8a-4be4-bde2-6738fdfc79d7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:23.104557 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-b8d856c1-c869-4119-aceb-1ba87898f59f req-14a493ca-3d8a-4be4-bde2-6738fdfc79d7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:23.122577 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-b8d856c1-c869-4119-aceb-1ba87898f59f req-14a493ca-3d8a-4be4-bde2-6738fdfc79d7 service nova] Creating event network-changed:7f449cbb-3372-41f5-95a8-c06ed623f20f for instance 809bf278-643f-4007-ab59-2b2134e4bfb9 on hv-cinder-73761 May 05 14:29:23.129077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-b8d856c1-c869-4119-aceb-1ba87898f59f req-14a493ca-3d8a-4be4-bde2-6738fdfc79d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039296 May 05 14:29:23.130364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1798/3289] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:29:23.741460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:23.742152 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:23.749099 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:23.749548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:23.750347 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:23.750786 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:23.883575 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:23.891472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-34adc303-c917-4bd6-8d33-228ccbebdccc tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.153959 May 05 14:29:23.892043 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1492/3290] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:23 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:24.909619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:24.910342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:24.916611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:24.917064 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:24.917813 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:24.918265 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:25.048736 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:25.055856 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b6e715cf-f5bf-4022-b982-56587e182aaa tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.150941 May 05 14:29:25.056422 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1799/3291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:24 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:26.072739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:26.073411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:26.081089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:26.081536 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:26.082343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:26.082783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:26.216238 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:26.223402 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6d29cba9-158a-4879-a069-6355e05b5905 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.154665 May 05 14:29:26.223966 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1493/3292] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:26 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:27.240826 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:27.241441 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:27.248584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:27.249038 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:27.249831 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:27.250304 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:27.380858 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:27.387772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-6d1d2708-7213-4a9c-8c11-cce61a5016da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.150791 May 05 14:29:27.388961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1800/3293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:27 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:27.562424 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-7e2ef404-4d1a-414d-96df-e53e820379ee req-457ed372-33cc-4591-a864-949622b05574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809bf278-643f-4007-ab59-2b2134e4bfb9", "name": "network-vif-plugged", "status": "completed", "tag": "7f449cbb-3372-41f5-95a8-c06ed623f20f"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:27.570972 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-7e2ef404-4d1a-414d-96df-e53e820379ee req-457ed372-33cc-4591-a864-949622b05574 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:27.571492 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-7e2ef404-4d1a-414d-96df-e53e820379ee req-457ed372-33cc-4591-a864-949622b05574 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:27.582946 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-7e2ef404-4d1a-414d-96df-e53e820379ee req-457ed372-33cc-4591-a864-949622b05574 service nova] Creating event network-vif-plugged:7f449cbb-3372-41f5-95a8-c06ed623f20f for instance 809bf278-643f-4007-ab59-2b2134e4bfb9 on hv-cinder-73761 May 05 14:29:27.588405 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-7e2ef404-4d1a-414d-96df-e53e820379ee req-457ed372-33cc-4591-a864-949622b05574 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029992 May 05 14:29:27.589349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1494/3294] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:29:28.405818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:28.406476 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:28.412459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:28.412913 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:28.413671 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:28.414143 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:28.538070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:28.545242 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-71764adf-dcdb-4dbe-be6c-7442379b4980 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1366 microversion: 2.1 time: 0.144074 May 05 14:29:28.545797 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1801/3295] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:28 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:29.563469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:29.564170 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:29.570222 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:29.570677 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:29.571444 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:29.571881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:29.703698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:29:29.711145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ce5b68b5-a819-4dc2-9ba9-2340c27a3390 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1557 microversion: 2.1 time: 0.152910 May 05 14:29:29.711713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1495/3296] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:29:29 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:29:29.729047 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:29:29.729576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:29:29.736211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:29.736666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:29.737434 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:29.737877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:29.813696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c830d210-9b9a-43f7-9d12-792653dc23da tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088500 May 05 14:29:29.814408 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1802/3297] 10.222.0.26 () {58 vars in 1274 bytes} [Thu May 5 14:29:29 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:29:30.810907 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-157a1b67-366d-49c9-b22b-245bdcd0ccc1 req-3b3367c8-231e-4667-ae14-b1ee39db0f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "809bf278-643f-4007-ab59-2b2134e4bfb9", "tag": "7f449cbb-3372-41f5-95a8-c06ed623f20f"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:29:30.819330 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-157a1b67-366d-49c9-b22b-245bdcd0ccc1 req-3b3367c8-231e-4667-ae14-b1ee39db0f32 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:29:30.819768 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-157a1b67-366d-49c9-b22b-245bdcd0ccc1 req-3b3367c8-231e-4667-ae14-b1ee39db0f32 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:29:30.831101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-157a1b67-366d-49c9-b22b-245bdcd0ccc1 req-3b3367c8-231e-4667-ae14-b1ee39db0f32 service nova] Creating event network-changed:7f449cbb-3372-41f5-95a8-c06ed623f20f for instance 809bf278-643f-4007-ab59-2b2134e4bfb9 on hv-cinder-73761 May 05 14:29:30.836434 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-157a1b67-366d-49c9-b22b-245bdcd0ccc1 req-3b3367c8-231e-4667-ae14-b1ee39db0f32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029285 May 05 14:29:30.837495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1496/3298] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:30:07.079029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:30:07.079683 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:30:07.086305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:30:07.086759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:30:07.087521 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:30:07.087958 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:30:07.110900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a15b21d2-1d58-4e72-a3e4-a9792b10187c tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9/ips" status: 200 len: 151 microversion: 2.1 time: 0.037262 May 05 14:30:07.115812 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1803/3299] 10.222.0.26 () {58 vars in 1247 bytes} [Thu May 5 14:30:07 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:07.235211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:07.235794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:07.242694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:07.243141 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:07.243899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:07.244334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:07.269547 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:31:07.609561 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4aa80351-6ae9-4448-a99b-1a3f808669f7 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 204 len: 0 microversion: 2.1 time: 0.430179 May 05 14:31:07.610413 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1497/3300] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:07 2022] DELETE /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:31:07.620127 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:07.620759 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:07.627412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:07.627903 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:07.628673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:07.629118 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:07.758626 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:07.766264 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e344e503-2c8e-4ad2-bd84-ca47ba603601 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1682 microversion: 2.1 time: 0.151024 May 05 14:31:07.766837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1804/3301] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:07 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:08.784076 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:08.784773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:08.791339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:08.791818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:08.792571 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:08.793004 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:08.920558 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:08.928522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-492d7667-626e-4627-a712-db26f4fa33e5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1682 microversion: 2.1 time: 0.148668 May 05 14:31:08.929089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1498/3302] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:08 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:09.946029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:09.947516 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:09.955320 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:09.961100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:09.961100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:09.961100 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:10.302628 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:10.313106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b17d4992-42ed-4ade-801a-81239fe10fae tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1615 microversion: 2.1 time: 0.370793 May 05 14:31:10.313916 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1805/3303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:09 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1615 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:10.377666 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-c8b3d039-3f35-41cd-99e1-ac07039736f0 req-9b748d4f-cbb7-40db-8a97-217e7c4d9372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809bf278-643f-4007-ab59-2b2134e4bfb9", "name": "network-vif-deleted", "tag": "7f449cbb-3372-41f5-95a8-c06ed623f20f"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:31:10.387737 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-c8b3d039-3f35-41cd-99e1-ac07039736f0 req-9b748d4f-cbb7-40db-8a97-217e7c4d9372 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:10.388165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-c8b3d039-3f35-41cd-99e1-ac07039736f0 req-9b748d4f-cbb7-40db-8a97-217e7c4d9372 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:10.400379 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-c8b3d039-3f35-41cd-99e1-ac07039736f0 req-9b748d4f-cbb7-40db-8a97-217e7c4d9372 service nova] Creating event network-vif-deleted:7f449cbb-3372-41f5-95a8-c06ed623f20f for instance 809bf278-643f-4007-ab59-2b2134e4bfb9 on hv-cinder-73761 May 05 14:31:10.405688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-c8b3d039-3f35-41cd-99e1-ac07039736f0 req-9b748d4f-cbb7-40db-8a97-217e7c4d9372 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095193 May 05 14:31:10.406753 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1499/3304] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:10.602964 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:10.603459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:10.620200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:10.624610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:10.624610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:10.624610 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:10.651562 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:31:11.009955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-62f634b5-8ffd-4f5d-9e6a-8f02d6719a91 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 204 len: 0 microversion: 2.1 time: 0.410592 May 05 14:31:11.011685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1806/3305] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:10 2022] DELETE /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:31:11.022274 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:11.025820 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:11.032776 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:11.033507 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:11.034520 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:11.035148 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:11.179505 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:11.187382 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-9844818e-fd29-496d-bfdf-8b99ec432d2c tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1507 microversion: 2.1 time: 0.171989 May 05 14:31:11.187956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1500/3306] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:11 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:11.331749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:11.332460 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:11.339207 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:11.339657 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:11.340961 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:11.341784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:11.375338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:11.375822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:11.376283 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lazy-loading 'fault' on Instance uuid 809bf278-643f-4007-ab59-2b2134e4bfb9 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:31:11.430334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795830eaa7be4737a520a63d3801e2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc1b60b8b0d4479970f34e29312783f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:11.439985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-1a8fb83a-0ca6-4f7c-9880-9a0c0e850022 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 200 len: 1331 microversion: 2.1 time: 0.112717 May 05 14:31:11.440572 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1807/3307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:11 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:12.204764 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:12.205324 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:12.212344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.212799 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.213587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.214019 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.260714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:12.266411 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:12.291608 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.292326 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.293970 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.294762 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.356700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:31:12.486398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:12.496702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-85be52a8-7133-4f7c-8f29-713b17fb1055 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1465 microversion: 2.1 time: 0.295743 May 05 14:31:12.498678 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1501/3308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:12 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:12.503358 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-4be0ed55-b1e5-4149-b459-3cd9a53105b9 req-d5cf21ac-8390-492b-8626-677243f56245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c40e0507-c34b-4015-9186-c21ad9a69e72", "name": "network-vif-deleted", "tag": "7614c088-27b6-400c-a06c-b3029502882a"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:31:12.516516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4be0ed55-b1e5-4149-b459-3cd9a53105b9 req-d5cf21ac-8390-492b-8626-677243f56245 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.517686 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-4be0ed55-b1e5-4149-b459-3cd9a53105b9 req-d5cf21ac-8390-492b-8626-677243f56245 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.536560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-4be0ed55-b1e5-4149-b459-3cd9a53105b9 req-d5cf21ac-8390-492b-8626-677243f56245 service nova] Creating event network-vif-deleted:7614c088-27b6-400c-a06c-b3029502882a for instance c40e0507-c34b-4015-9186-c21ad9a69e72 on hv-cinder-73761 May 05 14:31:12.546442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-4be0ed55-b1e5-4149-b459-3cd9a53105b9 req-d5cf21ac-8390-492b-8626-677243f56245 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041592 May 05 14:31:12.546442 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1502/3309] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:12.548258 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d5d14e-9371-4d0f-8b25-22c081bab3d9", "name": "network-vif-deleted", "tag": "59f851bd-09ad-417f-a01c-9de52a95c857"}, {"server_uuid": "a900c1d4-5ad8-4465-9f93-b1263bd89f66", "name": "network-vif-deleted", "tag": "9552713a-7887-402b-80fe-83abd608be5c"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:31:12.560875 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.561437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.578134 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] Creating event network-vif-deleted:59f851bd-09ad-417f-a01c-9de52a95c857 for instance e2d5d14e-9371-4d0f-8b25-22c081bab3d9 on hv-cinder-73761 May 05 14:31:12.578651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] Creating event network-vif-deleted:9552713a-7887-402b-80fe-83abd608be5c for instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 on hv-cinder-73761 May 05 14:31:12.585523 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-b94fade4-a751-42b0-af10-a06f524ca41c req-bfc8d16d-b30e-48a8-8a91-d2f914c3362b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042006 May 05 14:31:12.586159 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1503/3310] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:12.591377 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:12.592146 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:12.598346 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.603728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.603728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.603728 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.614451 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. May 05 14:31:12.615138 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:12.616205 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d84a6671-4703-42e7-8d7c-ad626ded3c37 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 404 len: 111 microversion: 2.1 time: 0.028836 May 05 14:31:12.616827 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1504/3311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:12 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:12.625656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4933cc23-f8e9-4844-be74-acff8023f0c5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '.version_select at 0x7fb4e81c2ca0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:12.638566 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.compute.api [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Instance is already in deleting state, ignoring this request May 05 14:31:12.639467 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8495ad49-d322-4213-a79e-bf83f781a3be tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 204 len: 0 microversion: 2.1 time: 0.382995 May 05 14:31:12.640129 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1808/3312] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:12 2022] DELETE /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 05 14:31:12.648136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:12.653363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:12.660455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.661363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.662244 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.662741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.697681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:12.698492 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:12.698949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.objects.instance [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lazy-loading 'fault' on Instance uuid a900c1d4-5ad8-4465-9f93-b1263bd89f66 {{(pid=123930) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:31:12.712623 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4933cc23-f8e9-4844-be74-acff8023f0c5 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363000474" status: 202 len: 0 microversion: 2.1 time: 0.091232 May 05 14:31:12.713439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1505/3313] 10.222.0.26 () {58 vars in 1217 bytes} [Thu May 5 14:31:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363000474 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 05 14:31:12.749664 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3337cd0a90cb4d72b093f6a912295125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c2d40011044e5d86c205f3cf09d56e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:12.759605 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b991160c-af33-4be3-908b-e164868db994 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 200 len: 1334 microversion: 2.1 time: 0.115387 May 05 14:31:12.769147 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1809/3314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:12 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 1334 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:31:13.515261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.515881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.523411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.525269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.526639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.528145 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.562801 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.563269 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.563757 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lazy-loading 'fault' on Instance uuid c40e0507-c34b-4015-9186-c21ad9a69e72 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:31:13.606659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:13.612872 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.614922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.615519 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5ea6d0d9-3732-4b8d-9624-bdb6611c93e0 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 200 len: 1312 microversion: 2.1 time: 0.103997 May 05 14:31:13.616272 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1506/3315] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:13 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:13.630220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.630616 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.631402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.631849 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.645853 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. May 05 14:31:13.646755 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.647609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-eb78a67f-4f59-49cc-8948-17d2cc08e5f8 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 404 len: 111 microversion: 2.1 time: 0.038559 May 05 14:31:13.648167 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1810/3316] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:13 2022] DELETE /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 05 14:31:13.660053 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.661294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: 809bf278-643f-4007-ab59-2b2134e4bfb9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.667688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.668239 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.669086 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.669702 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.684144 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. May 05 14:31:13.684766 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance 809bf278-643f-4007-ab59-2b2134e4bfb9 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.685600 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-65b63475-767c-4e0b-b60c-5055403c0030 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9" status: 404 len: 111 microversion: 2.1 time: 0.029819 May 05 14:31:13.686165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1507/3317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:13 2022] GET /compute/v2.1/servers/809bf278-643f-4007-ab59-2b2134e4bfb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:13.696457 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.696956 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.703113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.703563 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.704328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.704910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.719082 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. May 05 14:31:13.719676 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.720508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-17efe5b7-309b-4d02-ad7f-a95cde4f714d tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 404 len: 111 microversion: 2.1 time: 0.028704 May 05 14:31:13.721051 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1811/3318] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:13 2022] DELETE /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:13.729225 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.729925 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: ec3ad4cb-1146-4350-96be-fe67fe0595d7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.736318 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.736781 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.737639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.738455 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.752631 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. May 05 14:31:13.753232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance ec3ad4cb-1146-4350-96be-fe67fe0595d7 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.754065 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-a14ff1ae-685d-43b0-883b-2a1abd26bbfe tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7" status: 404 len: 111 microversion: 2.1 time: 0.028885 May 05 14:31:13.755101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1508/3319] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:13 2022] GET /compute/v2.1/servers/ec3ad4cb-1146-4350-96be-fe67fe0595d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:13.763057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.763558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.769298 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.769748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.771955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.771955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.777006 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.778082 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: a900c1d4-5ad8-4465-9f93-b1263bd89f66] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.784327 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.786633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.786633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.786633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.787302 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. May 05 14:31:13.787897 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.789113 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a32b72c9-48bf-41ea-83ec-041724a73cc4 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 404 len: 111 microversion: 2.1 time: 0.029943 May 05 14:31:13.790004 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1812/3320] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:13 2022] DELETE /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:13.798123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:13.798740 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] [instance: a7dcc206-30ae-4507-a017-691404eef1bc] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:13.802587 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 could not be found. May 05 14:31:13.803260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 404 to user: Instance a900c1d4-5ad8-4465-9f93-b1263bd89f66 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.804111 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7c47cea4-41c2-467f-b5b7-f2c9764f723b tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66" status: 404 len: 111 microversion: 2.1 time: 0.030988 May 05 14:31:13.804670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1509/3321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:13 2022] GET /compute/v2.1/servers/a900c1d4-5ad8-4465-9f93-b1263bd89f66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:13.805793 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.806279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.807052 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:13.807489 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:13.822617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] HTTP exception thrown: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. May 05 14:31:13.823289 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] Returning 404 to user: Instance a7dcc206-30ae-4507-a017-691404eef1bc could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:13.824132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7171e7f6-914f-4c60-942d-39166ddc4959 tempest-AttachVolumeNegativeTest-344743819 tempest-AttachVolumeNegativeTest-344743819-project] 10.222.0.26 "GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc" status: 404 len: 111 microversion: 2.1 time: 0.029974 May 05 14:31:13.824805 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1813/3322] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:13 2022] GET /compute/v2.1/servers/a7dcc206-30ae-4507-a017-691404eef1bc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:14.633772 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:14.634511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: c40e0507-c34b-4015-9186-c21ad9a69e72] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:14.641816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.642669 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:14.643518 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.644051 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:14.658773 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] HTTP exception thrown: Instance c40e0507-c34b-4015-9186-c21ad9a69e72 could not be found. May 05 14:31:14.659363 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Returning 404 to user: Instance c40e0507-c34b-4015-9186-c21ad9a69e72 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:14.660188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-646c9790-2df1-4b3e-b3d2-698cf8d5320d tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72" status: 404 len: 111 microversion: 2.1 time: 0.031748 May 05 14:31:14.669094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:14.669094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:14.672036 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1510/3323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:14 2022] GET /compute/v2.1/servers/c40e0507-c34b-4015-9186-c21ad9a69e72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:14.675388 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.675839 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:14.677132 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.677581 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:14.708149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:31:14.945968 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-4f85271e-680d-4243-952e-07d1a358927e tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 204 len: 0 microversion: 2.1 time: 0.280771 May 05 14:31:14.946569 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1814/3324] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:14 2022] DELETE /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:31:14.955121 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:14.955992 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:14.963126 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.963867 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:14.965142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:14.965769 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:15.118757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:15.119355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:15.128405 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:15.128847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:15.129841 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:15.130459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:15.147523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. May 05 14:31:15.150415 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 404 to user: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:15.151477 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-901a13d0-d4c5-4c86-b350-6ffd57136a85 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 404 len: 111 microversion: 2.1 time: 0.037915 May 05 14:31:15.152983 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1815/3325] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:31:15 2022] DELETE /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:15.160325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:15.161712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] [instance: 09aa3778-4ca9-460b-a8b8-8ecb90e011d2] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:15.171558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:15.171978 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:15.172952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:15.173398 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:15.175437 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:15.183559 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-93c76804-6569-4303-afe6-f4de2f2effd4 tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1521 microversion: 2.1 time: 0.232713 May 05 14:31:15.184129 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1511/3326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:14 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:15.195215 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] HTTP exception thrown: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. May 05 14:31:15.195765 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] Returning 404 to user: Instance 09aa3778-4ca9-460b-a8b8-8ecb90e011d2 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:15.196700 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8eeffa97-fb60-4892-8f36-d89ca8f6c484 tempest-AttachVolumeTestJSON-1613840458 tempest-AttachVolumeTestJSON-1613840458-project] 10.222.0.26 "GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2" status: 404 len: 111 microversion: 2.1 time: 0.040507 May 05 14:31:15.197570 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1816/3327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:15 2022] GET /compute/v2.1/servers/09aa3778-4ca9-460b-a8b8-8ecb90e011d2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:16.200690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:16.202314 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:16.209881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:16.210739 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:16.211743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:16.212349 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:16.476584 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-f52a00d3-87d6-41a4-9b60-a7cd6564218c req-e915071f-217f-4372-a08d-36f76e486a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8d7ea7-2cac-4aa7-8904-084ff69b44e9", "name": "network-vif-deleted", "tag": "44bcc933-613c-43d5-b972-9daca9d4c4d9"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:31:16.486564 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f52a00d3-87d6-41a4-9b60-a7cd6564218c req-e915071f-217f-4372-a08d-36f76e486a6d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:16.487105 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f52a00d3-87d6-41a4-9b60-a7cd6564218c req-e915071f-217f-4372-a08d-36f76e486a6d service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:16.499922 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-f52a00d3-87d6-41a4-9b60-a7cd6564218c req-e915071f-217f-4372-a08d-36f76e486a6d service nova] Creating event network-vif-deleted:44bcc933-613c-43d5-b972-9daca9d4c4d9 for instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 on hv-cinder-73761 May 05 14:31:16.505756 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-f52a00d3-87d6-41a4-9b60-a7cd6564218c req-e915071f-217f-4372-a08d-36f76e486a6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034284 May 05 14:31:16.506741 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1817/3328] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:16.581394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b10632cbf11b46b2b94afd5df59daa25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054a05e1c0b4300addba50adfb442ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:31:16.589708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-573099e6-8df7-43a4-9278-20a16cb7343a tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 200 len: 1479 microversion: 2.1 time: 0.392872 May 05 14:31:16.590366 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1512/3329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:16 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 1479 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:17.616359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:17.616359 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] [instance: 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:31:17.643223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:17.644279 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:17.645478 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:31:17.646146 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:31:17.686301 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] HTTP exception thrown: Instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 could not be found. May 05 14:31:17.687341 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] Returning 404 to user: Instance 2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:31:17.688576 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-8a8765f7-134e-423f-894c-da4be828d8fc tempest-ServerRescueNegativeTestJSON-221167628 tempest-ServerRescueNegativeTestJSON-221167628-project] 10.222.0.26 "GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9" status: 404 len: 111 microversion: 2.1 time: 0.085196 May 05 14:31:17.697025 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1818/3330] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:31:17 2022] GET /compute/v2.1/servers/2a8d7ea7-2cac-4aa7-8904-084ff69b44e9 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:31:25.053957 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-129218ba-4455-4f20-9622-67d510bd65ab tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e81f3b80>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:25.109752 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-129218ba-4455-4f20-9622-67d510bd65ab tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/32089b0b-e954-45b8-ab4e-5817207f46be" status: 200 len: 350 microversion: 2.1 time: 0.062098 May 05 14:31:25.110609 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1513/3331] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 14:31:25 2022] GET /compute/v2.1/os-volumes/32089b0b-e954-45b8-ab4e-5817207f46be => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:26.720425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-815e4709-86de-462f-9920-a887ca3041c1 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e81cb160>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:26.767305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-815e4709-86de-462f-9920-a887ca3041c1 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/6672a1ec-8f45-486c-98ca-d23a5472e4c1" status: 200 len: 350 microversion: 2.1 time: 0.053493 May 05 14:31:26.767868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1819/3332] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 14:31:26 2022] GET /compute/v2.1/os-volumes/6672a1ec-8f45-486c-98ca-d23a5472e4c1 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:28.433694 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-da169205-737e-406d-b039-9e01c9f7596a tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4ec248670>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.482959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-da169205-737e-406d-b039-9e01c9f7596a tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b5724285-3194-4ffb-9f9f-a60fd00bc5ca" status: 200 len: 351 microversion: 2.1 time: 0.052903 May 05 14:31:28.483539 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1514/3333] 10.222.0.26 () {58 vars in 1244 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes/b5724285-3194-4ffb-9f9f-a60fd00bc5ca => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:28.495844 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9eb1a692-7ba1-4132-8339-670507e28c87 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e836ce50>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.582213 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9eb1a692-7ba1-4132-8339-670507e28c87 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090652 May 05 14:31:28.582777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1820/3334] 10.222.0.26 () {58 vars in 1133 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:28.595564 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bce8110e-59a9-431a-8d05-9a3b2cea94a3 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e8114280>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.680545 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bce8110e-59a9-431a-8d05-9a3b2cea94a3 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088902 May 05 14:31:28.681115 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1515/3335] 10.222.0.26 () {58 vars in 1148 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:28.692908 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9b50e5c4-91fa-4ceb-a17b-655293d2930c tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4ec212ee0>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.775781 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9b50e5c4-91fa-4ceb-a17b-655293d2930c tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086593 May 05 14:31:28.776338 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1821/3336] 10.222.0.26 () {58 vars in 1133 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:31:28.787649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4842135d-dc2a-4b42-986c-e2f692c8f58c tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e81143a0>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.870881 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4842135d-dc2a-4b42-986c-e2f692c8f58c tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087033 May 05 14:31:28.871531 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1516/3337] 10.222.0.26 () {58 vars in 1166 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:28.884722 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-7842e880-4221-481c-aa68-030f58b2eda9 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e81cb160>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:28.969254 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-7842e880-4221-481c-aa68-030f58b2eda9 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088732 May 05 14:31:28.969827 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1822/3338] 10.222.0.26 () {58 vars in 1169 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:31:28.983639 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-49fcc33e-7a20-46b0-abb6-b3bf2a1f7776 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e2feb310>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:29.064670 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-49fcc33e-7a20-46b0-abb6-b3bf2a1f7776 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084627 May 05 14:31:29.065221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1517/3339] 10.222.0.26 () {58 vars in 1154 bytes} [Thu May 5 14:31:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:31:29.078996 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-774fb263-116a-47d7-a601-1eb3fa566668 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e8310f70>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:29.167299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-774fb263-116a-47d7-a601-1eb3fa566668 tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091992 May 05 14:31:29.168117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1823/3340] 10.222.0.26 () {58 vars in 1187 bytes} [Thu May 5 14:31:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:31:29.179522 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-00f4f040-402d-4855-b1b3-3df237f8369a tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] Calling method '.version_select at 0x7fb4e81c2d30>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:31:29.258849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-00f4f040-402d-4855-b1b3-3df237f8369a tempest-VolumesTestJSON-141405469 tempest-VolumesTestJSON-141405469-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082996 May 05 14:31:29.271167 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1518/3341] 10.222.0.26 () {58 vars in 1154 bytes} [Thu May 5 14:31:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:32:59.922976 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6445cb42-dade-4bac-83b4-bdd00ab04819] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 05 14:33:00.093162 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Action: 'create', calling method: .version_select at 0x7fb4e81cb670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1052745510"}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:33:00.110611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:33:00.115104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for user 45c51cdca57f49ad98a58c9affb7e6b8 and project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:33:00.375071 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:33:00.379582 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for user 45c51cdca57f49ad98a58c9affb7e6b8 and project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'key_pairs'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:33:00.396423 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0b1b455d-3e8e-4cc0-934a-a6e371394de6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.475293 May 05 14:33:00.397022 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1824/3342] 10.222.0.26 () {60 vars in 1157 bytes} [Thu May 5 14:32:59 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:19.057819 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1973288842", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052745510", "security_groups": [{"name": "tempest-secgroup-smoke-500731382"}], "block_device_mapping_v2": [{"uuid": "adc93e5e-0b9c-4130-bead-13a90560f86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d61bd37a-2dff-4eeb-b9c3-5397af2c9799"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:33:19.165845 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] validate_networks() for [('d61bd37a-2dff-4eeb-b9c3-5397af2c9799', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:33:19.600918 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:33:19.601344 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:33:19.601818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:33:19.602265 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:33:19.602680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:33:19.611371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:19.611816 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:19.612606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:19.613037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:19.629682 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:33:19.634251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for user 45c51cdca57f49ad98a58c9affb7e6b8 and project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:33:19.689388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:33:19.691515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adc93e5e-0b9c-4130-bead-13a90560f86d',volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:33:20.116915 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1d46c8f8-d725-46fd-b320-83fa9e55e0ea tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064557 May 05 14:33:20.118259 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1519/3343] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:33:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 14:33:20.129536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5513d717-1182-4315-816c-4a089c0a05b2 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:20.132545 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5513d717-1182-4315-816c-4a089c0a05b2 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:20.141419 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO oslo.messaging._drivers.impl_rabbit [-] [6445cb42-dade-4bac-83b4-bdd00ab04819] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 55216. May 05 14:33:20.236818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5513d717-1182-4315-816c-4a089c0a05b2 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:20.244421 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5513d717-1182-4315-816c-4a089c0a05b2 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1095 microversion: 2.1 time: 0.119892 May 05 14:33:20.244985 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1825/3344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:20 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1095 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:21.261294 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:21.261831 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:21.268516 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:21.268951 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:21.269715 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:21.270196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:21.330003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:21.338049 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bf2a3b66-627a-4708-8c3f-4b3eca44784c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1145 microversion: 2.1 time: 0.081502 May 05 14:33:21.338606 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1520/3345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:21 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:22.355444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:22.355981 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:22.362292 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:22.362743 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:22.363502 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:22.363930 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:22.427703 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:22.436123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-73d3a13a-8534-4002-ab84-7b8f1adc2a26 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1211 microversion: 2.1 time: 0.085171 May 05 14:33:22.436729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1826/3346] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:22 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:23.453093 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:23.453719 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:23.460253 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:23.460706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:23.461486 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:23.461928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:23.869904 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:23.879017 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5ac23751-6b76-45cd-8f08-5890d2d3ebde tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.429810 May 05 14:33:23.879652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1521/3347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:23 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:24.051218 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-dd4d2f68-0e21-429b-b974-0fdbf31c8779 req-6b184d44-7fb7-4537-a331-84db3ebe03c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c5107d-9622-4f16-92cc-e3536d00f8b7", "tag": "3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:33:24.060401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-dd4d2f68-0e21-429b-b974-0fdbf31c8779 req-6b184d44-7fb7-4537-a331-84db3ebe03c0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:24.060859 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-dd4d2f68-0e21-429b-b974-0fdbf31c8779 req-6b184d44-7fb7-4537-a331-84db3ebe03c0 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:24.073459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-dd4d2f68-0e21-429b-b974-0fdbf31c8779 req-6b184d44-7fb7-4537-a331-84db3ebe03c0 service nova] Creating event network-changed:3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342 for instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 on hv-cinder-73761 May 05 14:33:24.078622 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-dd4d2f68-0e21-429b-b974-0fdbf31c8779 req-6b184d44-7fb7-4537-a331-84db3ebe03c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091404 May 05 14:33:24.085818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1827/3348] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:33:24.905432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:24.906150 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:24.912838 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:24.913284 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:24.914110 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:24.915089 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:25.043791 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:25.051193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-8346172c-ac39-4d2f-ba36-e2efa89466fd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.149668 May 05 14:33:25.051778 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1522/3349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:24 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:33:26.069271 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:26.069965 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:26.076682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:26.077131 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:26.077882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:26.078349 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:26.221347 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:26.228696 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c041cea9-9a4f-46e7-8970-6b3486d8b813 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.164155 May 05 14:33:26.229263 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1828/3350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:26 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:27.244854 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:27.245472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:27.251924 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:27.252376 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:27.253139 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:27.253581 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:27.381241 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:27.388633 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-948aaae0-7383-4e1c-9ca4-973040f3ecca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.147874 May 05 14:33:27.389193 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1523/3351] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:27 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:28.405474 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:28.406006 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:28.412418 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:28.412868 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:28.413660 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:28.414642 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:28.543177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:28.550455 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-b33e61b0-792f-4cb3-941a-82c2eacb7435 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.148867 May 05 14:33:28.551013 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1829/3352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:28 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:29.567123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:29.567659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:29.575232 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:29.575690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:29.576470 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:29.576903 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:29.706254 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:29.713538 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-d8407e8b-4cc9-4219-9f2a-78727a63c1c4 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.150323 May 05 14:33:29.714114 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1524/3353] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:29 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:30.730107 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:30.730718 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:30.737109 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:30.737553 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:30.738334 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:30.738769 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:30.872592 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:30.876806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0aa6e758-eaff-4630-9b14-07f62d3358bd tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.150558 May 05 14:33:30.877387 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1830/3354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:30 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:31.894548 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:31.895157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:31.901990 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:31.902511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:31.903270 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:31.903708 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:32.033018 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:32.042928 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-03b526f5-86e1-45c8-a187-5599dfa2dadf tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.152203 May 05 14:33:32.043497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1525/3355] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:31 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:33.059641 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:33.060314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:33.066670 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:33.067724 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:33.067935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:33.068377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:33.197777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:33.205057 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-817faca5-90cb-45c8-8b08-ca63d0745008 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.149363 May 05 14:33:33.205629 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1831/3356] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:33 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:34.222260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:34.222880 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:34.229783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:34.230268 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:34.231030 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:34.231471 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:34.359588 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:34.366973 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6cc56e06-9770-4f60-8ed8-bc48f6b8440f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.148699 May 05 14:33:34.367542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1526/3357] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:34 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:35.384412 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:35.385027 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:35.391867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:35.392317 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:35.393078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:35.393513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:35.530237 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:35.537782 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-57938f51-b7f2-47c2-9c0c-3b50e43f8631 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.157151 May 05 14:33:35.538404 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1832/3358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:35 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:35.553189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-231f4d5d-67f4-45d0-98c6-582e9ea144f3 req-1892397f-0686-4559-bfc8-f4634953d85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c5107d-9622-4f16-92cc-e3536d00f8b7", "name": "network-vif-plugged", "status": "completed", "tag": "3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:33:35.562657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-231f4d5d-67f4-45d0-98c6-582e9ea144f3 req-1892397f-0686-4559-bfc8-f4634953d85f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:35.563247 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-231f4d5d-67f4-45d0-98c6-582e9ea144f3 req-1892397f-0686-4559-bfc8-f4634953d85f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:35.575039 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-231f4d5d-67f4-45d0-98c6-582e9ea144f3 req-1892397f-0686-4559-bfc8-f4634953d85f service nova] Creating event network-vif-plugged:3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342 for instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 on hv-cinder-73761 May 05 14:33:35.580184 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-231f4d5d-67f4-45d0-98c6-582e9ea144f3 req-1892397f-0686-4559-bfc8-f4634953d85f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090820 May 05 14:33:35.585726 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1527/3359] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:33:36.553458 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:36.554136 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:36.560462 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:36.560910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:36.561663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:36.562117 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:36.691363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:36.699329 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0767c475-26dc-4ebe-bea9-f241f731206e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1266 microversion: 2.1 time: 0.149673 May 05 14:33:36.699887 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1833/3360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:36 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:37.716948 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:37.717643 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:37.724317 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:37.724763 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:37.725515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:37.725956 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:37.852319 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:37.860542 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-4020839e-9ed3-4645-bf9a-1dec23cb7f60 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1453 microversion: 2.1 time: 0.148327 May 05 14:33:37.861128 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1528/3361] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:37 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:37.878090 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:33:37.878708 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:33:37.885646 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:37.886123 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:37.886879 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:37.887314 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:38.012706 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:33:38.020363 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ef93947f-9af6-4b22-9a75-96d610617299 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1453 microversion: 2.1 time: 0.146134 May 05 14:33:38.020969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1834/3362] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:33:37 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:33:40.029808 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-2f88d982-dc6a-41e7-9f3f-486922e84844 req-9d6a84db-00d4-4198-8568-109b00cef13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c5107d-9622-4f16-92cc-e3536d00f8b7", "tag": "3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:33:40.038597 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-2f88d982-dc6a-41e7-9f3f-486922e84844 req-9d6a84db-00d4-4198-8568-109b00cef13c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:33:40.039040 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-2f88d982-dc6a-41e7-9f3f-486922e84844 req-9d6a84db-00d4-4198-8568-109b00cef13c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:33:40.050388 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-2f88d982-dc6a-41e7-9f3f-486922e84844 req-9d6a84db-00d4-4198-8568-109b00cef13c service nova] Creating event network-changed:3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342 for instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 on hv-cinder-73761 May 05 14:33:40.055652 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-2f88d982-dc6a-41e7-9f3f-486922e84844 req-9d6a84db-00d4-4198-8568-109b00cef13c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029814 May 05 14:33:40.057060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1529/3363] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:35:35.364056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:35.364606 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:35.370439 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:35.370885 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:35.371638 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:35.372078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:35.397097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Going to try to terminate instance {{(pid=123930) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:35:35.658234 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3d456f75-188c-493c-9bbc-087b26c8f014 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 204 len: 0 microversion: 2.1 time: 0.298659 May 05 14:35:35.658809 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1835/3364] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:35:35 2022] DELETE /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:35:35.668488 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:35.669189 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:35.675357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:35.675811 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:35.676628 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:35.677062 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:35.812577 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:35.820034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7d4f12a8-78c5-4ed8-ac0d-572f1d5b2cae tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1578 microversion: 2.1 time: 0.156809 May 05 14:35:35.820611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1530/3365] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:35 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:36.837884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:36.838611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:36.845211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:36.845659 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:36.846453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:36.846888 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:36.974946 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:36.982313 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-88edb56a-5832-4faf-9ce8-ceb99cf2d7ec tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1578 microversion: 2.1 time: 0.149284 May 05 14:35:36.982884 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1836/3366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:36 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:37.999794 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:38.000469 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:38.007011 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:38.007476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:38.008245 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:38.008690 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:38.074157 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:38.082464 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5b5ff3e3-8d92-476e-8d96-58eaba43e167 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1511 microversion: 2.1 time: 0.086757 May 05 14:35:38.083339 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1531/3367] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:37 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:38.096654 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-0f54c8d7-180b-48fa-9610-62507288b96f req-5bf71981-13eb-4ee0-83de-08d5cda2f075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c5107d-9622-4f16-92cc-e3536d00f8b7", "name": "network-vif-deleted", "tag": "3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:35:38.106077 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-0f54c8d7-180b-48fa-9610-62507288b96f req-5bf71981-13eb-4ee0-83de-08d5cda2f075 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:38.106523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-0f54c8d7-180b-48fa-9610-62507288b96f req-5bf71981-13eb-4ee0-83de-08d5cda2f075 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:38.117342 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-0f54c8d7-180b-48fa-9610-62507288b96f req-5bf71981-13eb-4ee0-83de-08d5cda2f075 service nova] Creating event network-vif-deleted:3e5ce3fa-ddb3-417f-8f87-0b61ff1f1342 for instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 on hv-cinder-73761 May 05 14:35:38.122484 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-0f54c8d7-180b-48fa-9610-62507288b96f req-5bf71981-13eb-4ee0-83de-08d5cda2f075 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030433 May 05 14:35:38.123337 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1837/3368] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:35:39.101472 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:39.103556 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:39.112321 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:39.113158 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:39.114651 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:39.115691 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:39.151731 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:39.152188 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:39.152649 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.objects.instance [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lazy-loading 'fault' on Instance uuid 52c5107d-9622-4f16-92cc-e3536d00f8b7 {{(pid=123931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 05 14:35:39.195836 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:39.203480 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cc1d6cf0-58c9-44b2-a3c7-3c54882cd062 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 200 len: 1231 microversion: 2.1 time: 0.107201 May 05 14:35:39.204078 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1532/3369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:39 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:35:40.221346 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:40.222066 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:40.228290 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:40.228745 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:40.229506 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:40.229944 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:40.243328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] HTTP exception thrown: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. May 05 14:35:40.243910 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Returning 404 to user: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:35:40.244720 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e7904fd5-1045-4ab9-898f-4c5cbb977773 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 404 len: 111 microversion: 2.1 time: 0.028059 May 05 14:35:40.245240 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1838/3370] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:40 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:35:40.291334 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-298980404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052745510", "security_groups": [{"name": "tempest-secgroup-smoke-500731382"}], "block_device_mapping_v2": [{"uuid": "adc93e5e-0b9c-4130-bead-13a90560f86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d61bd37a-2dff-4eeb-b9c3-5397af2c9799"}]}} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:35:40.399130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.network.neutron [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] validate_networks() for [('d61bd37a-2dff-4eeb-b9c3-5397af2c9799', None, None, None, None, None)] {{(pid=123931) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:35:40.766218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:35:40.766647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image limits 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:35:40.767122 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:35:40.767560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image pref 0:0:0 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:35:40.767974 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.virt.hardware [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:35:40.776991 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:40.777436 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:40.778264 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:40.778700 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:40.795501 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:35:40.799277 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.quota [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for user 45c51cdca57f49ad98a58c9affb7e6b8 and project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123931) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:35:40.853899 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Going to run 1 instances... {{(pid=123931) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:35:40.856067 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adc93e5e-0b9c-4130-bead-13a90560f86d',volume_size=None,volume_type=None)] {{(pid=123931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:35:41.234857 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-6120992b-8c27-45cb-a3d1-ba47c8bbed8e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.947880 May 05 14:35:41.238398 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1533/3371] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:35:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 14:35:41.247011 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a0258ae2-81b4-4bc9-a27f-74a320d4c6a3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:41.247837 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a0258ae2-81b4-4bc9-a27f-74a320d4c6a3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:41.306496 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-a0258ae2-81b4-4bc9-a27f-74a320d4c6a3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:41.313712 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a0258ae2-81b4-4bc9-a27f-74a320d4c6a3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1094 microversion: 2.1 time: 0.071448 May 05 14:35:41.314401 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1839/3372] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:41 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:35:42.331362 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:42.331982 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:42.338714 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:42.339171 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:42.339938 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:42.340378 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:42.399891 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:42.407218 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-740215de-473c-42e7-9da6-e4c777321d3b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1136 microversion: 2.1 time: 0.080178 May 05 14:35:42.407784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1534/3373] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:42 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1136 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:43.423691 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:43.424532 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:43.434682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:43.435247 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:43.436060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:43.436508 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:43.497023 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:43.504817 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ee5fbdb2-9f91-4866-88ee-d1ff86fbd03d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1210 microversion: 2.1 time: 0.085036 May 05 14:35:43.505397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1840/3374] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:43 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:44.522459 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:44.523042 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:44.530372 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:44.530937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:44.531818 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:44.532357 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:44.675090 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:44.683476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ce47a5ee-e5ab-4e06-abe4-f6cc9499ce3f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.165350 May 05 14:35:44.683993 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1535/3375] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:44 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:44.958291 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-775fb463-5317-4db8-9000-f4738e3cdc6c req-d10771d2-d941-4ab3-a7e2-9d644eadde9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67167cd-e478-4c74-a50a-b23979b18a22", "tag": "72d483ca-18c2-4311-ae00-86033cec4c01"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:35:44.971453 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-775fb463-5317-4db8-9000-f4738e3cdc6c req-d10771d2-d941-4ab3-a7e2-9d644eadde9c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:44.973015 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-775fb463-5317-4db8-9000-f4738e3cdc6c req-d10771d2-d941-4ab3-a7e2-9d644eadde9c service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:44.987016 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-775fb463-5317-4db8-9000-f4738e3cdc6c req-d10771d2-d941-4ab3-a7e2-9d644eadde9c service nova] Creating event network-changed:72d483ca-18c2-4311-ae00-86033cec4c01 for instance f67167cd-e478-4c74-a50a-b23979b18a22 on hv-cinder-73761 May 05 14:35:44.993096 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-775fb463-5317-4db8-9000-f4738e3cdc6c req-d10771d2-d941-4ab3-a7e2-9d644eadde9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038674 May 05 14:35:44.993697 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1841/3376] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:35:45.701392 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:45.702003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:45.708822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:45.709446 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:45.710251 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:45.711526 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:45.847847 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:45.855509 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-156f3832-5c75-4f34-aef7-79790e5ddc63 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.158462 May 05 14:35:45.856073 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1536/3377] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:45 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:46.873806 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:46.874536 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:46.883880 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:46.884459 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:46.885233 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:46.885666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:47.029299 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:47.036935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-0b6fdff3-b846-4c91-87ec-2062b048a738 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.169129 May 05 14:35:47.037509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1842/3378] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:46 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:48.054981 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:48.055499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:48.061868 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:48.062355 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:48.063123 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:48.063563 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:48.191625 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:48.198978 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-1c0e167e-9f0a-435a-8005-b336eb4c9c1f tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.148581 May 05 14:35:48.199543 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1537/3379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:48 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:49.215595 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:49.216223 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:49.222692 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:49.223149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:49.223952 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:49.224400 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:49.350007 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:49.357397 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-9531276a-edd8-4c5e-a08a-939dbc865227 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.145684 May 05 14:35:49.357899 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1843/3380] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:49 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:50.374493 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:50.375037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:50.381057 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:50.381512 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:50.382842 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:50.383288 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:50.510494 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:50.517688 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-bc31f955-8b6d-4a00-b7e2-1432c1570eda tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.147440 May 05 14:35:50.518302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1538/3381] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:50 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:51.534558 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:51.535097 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:51.541679 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:51.542149 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:51.542902 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:51.543344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:51.669319 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:51.676535 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-21f61189-5ced-4472-af9b-d8b4edbc7515 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.146119 May 05 14:35:51.677094 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1844/3382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:51 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:52.693137 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:52.693659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:52.700789 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:52.701242 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:52.702035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:52.702476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:52.832109 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:52.839340 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-f24c25d2-8bd3-4953-b506-6ea1104fa66c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.150143 May 05 14:35:52.839906 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1539/3383] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:52 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:53.856068 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:53.856689 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:53.863121 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:53.863578 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:53.864345 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:53.864792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:53.978729 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-166c1b83-730c-4c30-b4aa-40e652ff40d7 req-542e797c-5162-4287-a402-ee38cc666fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67167cd-e478-4c74-a50a-b23979b18a22", "name": "network-vif-plugged", "status": "completed", "tag": "72d483ca-18c2-4311-ae00-86033cec4c01"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:35:53.987243 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-166c1b83-730c-4c30-b4aa-40e652ff40d7 req-542e797c-5162-4287-a402-ee38cc666fe5 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:53.987698 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-166c1b83-730c-4c30-b4aa-40e652ff40d7 req-542e797c-5162-4287-a402-ee38cc666fe5 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:53.995607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:53.999003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-166c1b83-730c-4c30-b4aa-40e652ff40d7 req-542e797c-5162-4287-a402-ee38cc666fe5 service nova] Creating event network-vif-plugged:72d483ca-18c2-4311-ae00-86033cec4c01 for instance f67167cd-e478-4c74-a50a-b23979b18a22 on hv-cinder-73761 May 05 14:35:54.003509 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-5e9f231d-da23-459c-88a6-90ac8ae31af1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.151284 May 05 14:35:54.004101 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-166c1b83-730c-4c30-b4aa-40e652ff40d7 req-542e797c-5162-4287-a402-ee38cc666fe5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029744 May 05 14:35:54.004230 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1845/3384] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:53 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:54.004784 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1540/3385] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:35:55.020686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:55.021294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:55.027666 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:55.028125 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:55.028878 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:55.029318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:55.156607 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:55.164074 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-190d11b7-c95d-4c6f-9ad2-4d591a1b64af tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1265 microversion: 2.1 time: 0.147209 May 05 14:35:55.164681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1846/3386] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:55 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:56.182261 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:56.182967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:56.189136 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:56.189589 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:56.190384 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:56.190823 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:56.335165 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:56.342580 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-102fb9dd-5d4d-4196-9fed-576da9cf654d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1452 microversion: 2.1 time: 0.165610 May 05 14:35:56.343151 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1541/3387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:56 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:56.359226 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:35:56.359773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:35:56.366139 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:56.366590 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:56.367343 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:56.367777 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:56.495469 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:35:56.503169 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-cd3ca78c-08e8-43c7-be94-284a92428c4c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1452 microversion: 2.1 time: 0.147771 May 05 14:35:56.503729 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1847/3388] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:35:56 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:35:58.814403 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-d75b4270-9979-404a-9569-9b6cfc7b7499 req-0491859b-6388-46ab-b8d1-0b3f9ba851a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67167cd-e478-4c74-a50a-b23979b18a22", "tag": "72d483ca-18c2-4311-ae00-86033cec4c01"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:35:58.823659 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d75b4270-9979-404a-9569-9b6cfc7b7499 req-0491859b-6388-46ab-b8d1-0b3f9ba851a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:35:58.824104 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-d75b4270-9979-404a-9569-9b6cfc7b7499 req-0491859b-6388-46ab-b8d1-0b3f9ba851a7 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:35:58.835012 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-d75b4270-9979-404a-9569-9b6cfc7b7499 req-0491859b-6388-46ab-b8d1-0b3f9ba851a7 service nova] Creating event network-changed:72d483ca-18c2-4311-ae00-86033cec4c01 for instance f67167cd-e478-4c74-a50a-b23979b18a22 on hv-cinder-73761 May 05 14:35:58.839788 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-d75b4270-9979-404a-9569-9b6cfc7b7499 req-0491859b-6388-46ab-b8d1-0b3f9ba851a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029198 May 05 14:35:58.840447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1542/3389] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:37:34.200501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1627334860", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1052745510", "security_groups": [{"name": "tempest-secgroup-smoke-500731382"}], "block_device_mapping_v2": [{"uuid": "7e891a1c-4d08-418c-b69b-dc2b3a87e604", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d61bd37a-2dff-4eeb-b9c3-5397af2c9799"}]}} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:37:34.306969 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.network.neutron [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] validate_networks() for [('d61bd37a-2dff-4eeb-b9c3-5397af2c9799', None, None, None, None, None)] {{(pid=123930) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 05 14:37:34.721818 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 05 14:37:34.722287 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image limits 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 05 14:37:34.722792 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Flavor pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 05 14:37:34.723201 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Image pref 0:0:0 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 05 14:37:34.723611 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.virt.hardware [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123930) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 05 14:37:34.732177 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:34.732624 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:34.733425 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:34.733863 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:34.751134 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 05 14:37:34.755869 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.quota [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Getting quotas for user 45c51cdca57f49ad98a58c9affb7e6b8 and project 7a084d2891c54840b90480c5b8aa4e6a. Resources: {'instances', 'cores', 'ram'} {{(pid=123930) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 05 14:37:34.811305 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Going to run 1 instances... {{(pid=123930) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 05 14:37:34.813437 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7e891a1c-4d08-418c-b69b-dc2b3a87e604',volume_size=None,volume_type=None)] {{(pid=123930) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 05 14:37:35.182685 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-a07f340a-449d-4676-b6c2-a202b12262c3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.986908 May 05 14:37:35.183339 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1848/3390] 10.222.0.26 () {60 vars in 1146 bytes} [Thu May 5 14:37:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 05 14:37:35.195435 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-740c734b-8c99-4f57-bf93-091238515896 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:35.196445 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-740c734b-8c99-4f57-bf93-091238515896 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:35.315529 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-740c734b-8c99-4f57-bf93-091238515896 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:35.322130 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-740c734b-8c99-4f57-bf93-091238515896 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1095 microversion: 2.1 time: 0.132607 May 05 14:37:35.322689 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1543/3391] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:35 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1095 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:36.340183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:36.340807 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:36.346911 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:36.350364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:36.350364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:36.350364 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:36.412182 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:36.420331 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-e67fced8-dbbc-42ee-b2a5-18adefabc86d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1137 microversion: 2.1 time: 0.084710 May 05 14:37:36.420893 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1849/3392] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:36 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:37.437517 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:37.438448 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:37.446009 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:37.446650 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:37.447439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:37.447916 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:37.511200 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:37.518869 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-74890f75-24e7-4817-8772-7b7231f6f321 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1211 microversion: 2.1 time: 0.085412 May 05 14:37:37.519479 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1544/3393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:37 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:38.538501 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:38.539842 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:38.549325 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:38.549785 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:38.550619 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:38.551649 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:38.689900 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:38.698710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [req-846eb462-db1f-49bf-bd4f-e03c49e8e42d req-fba96238-212b-40ca-8637-f145437a0b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be697ed3-253f-4b3a-b348-2ae4925d2978", "tag": "cddc588a-3a0b-4930-84e9-56671c29db25"}]} {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:37:38.709211 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-846eb462-db1f-49bf-bd4f-e03c49e8e42d req-fba96238-212b-40ca-8637-f145437a0b9a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:38.709740 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [req-846eb462-db1f-49bf-bd4f-e03c49e8e42d req-fba96238-212b-40ca-8637-f145437a0b9a service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:38.710882 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-ae2b6bfb-f0ee-4bb9-bb9f-7fa158d5219d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.177302 May 05 14:37:38.711923 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1850/3394] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:38 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:38.727864 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.compute.server_external_events [req-846eb462-db1f-49bf-bd4f-e03c49e8e42d req-fba96238-212b-40ca-8637-f145437a0b9a service nova] Creating event network-changed:cddc588a-3a0b-4930-84e9-56671c29db25 for instance be697ed3-253f-4b3a-b348-2ae4925d2978 on hv-cinder-73761 May 05 14:37:38.733467 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [req-846eb462-db1f-49bf-bd4f-e03c49e8e42d req-fba96238-212b-40ca-8637-f145437a0b9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039344 May 05 14:37:38.734281 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1545/3395] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 05 14:37:39.729525 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:39.730183 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:39.736596 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:39.737054 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:39.737824 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:39.738294 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:39.868358 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:39.875686 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f244edcd-2b10-46f2-ae0e-d18fb7ec0aba tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.150032 May 05 14:37:39.876260 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1851/3396] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:39 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:40.892998 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:40.893697 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:40.900892 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:40.901342 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:40.902135 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:40.902576 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:41.030822 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:41.038142 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-39f2f4eb-31db-4c70-b624-d75405410329 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.149266 May 05 14:37:41.038713 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1546/3397] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:40 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:42.055211 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:42.055783 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:42.061935 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:42.062410 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:42.063178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:42.063617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:42.189523 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:42.197390 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-325eb419-5884-467b-8013-73eb9b3ed70a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.146649 May 05 14:37:42.197949 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1852/3398] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:42 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:43.214375 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:43.215003 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:43.221396 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:43.221850 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:43.222656 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:43.223100 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:43.352373 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:43.359621 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-7639417c-4f20-4b05-8a45-dfbc2c17cae1 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.149130 May 05 14:37:43.360192 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1547/3399] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:43 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:44.376181 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:44.376693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:44.383442 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:44.383894 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:44.384661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:44.385106 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:44.513667 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:44.521475 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-58900f77-e6ea-4bb8-a92a-8d982dd17c0d tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.149346 May 05 14:37:44.522056 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1853/3400] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:44 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:45.538221 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:45.538751 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:45.545084 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:45.545535 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:45.546337 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:45.546777 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:45.680866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:45.688515 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26516f13-114a-42d9-bdf9-e758aded4b35 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.153982 May 05 14:37:45.689005 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1548/3401] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:45 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:46.705155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:46.705773 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:46.712293 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:46.712748 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:46.713513 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:46.713955 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:46.840024 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:46.847328 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-f154c087-f995-4ab5-aa83-2430cb5bef58 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.146044 May 05 14:37:46.848432 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1854/3402] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:46 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:47.864352 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:47.864961 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:47.871302 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:47.871745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:47.872495 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:47.872927 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:47.998647 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:48.007220 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-308e4da5-6bbe-4c7e-9cb8-17a4ec961e2a tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.146683 May 05 14:37:48.007783 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1549/3403] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:47 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:49.023828 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:49.024440 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:49.030862 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:49.031318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:49.032080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:49.032526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:49.162799 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:49.170078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-c59c48cc-99d7-4031-a30e-6293aab982c0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.150120 May 05 14:37:49.170633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1855/3404] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:49 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:50.187117 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:50.187735 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:50.194419 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:50.194871 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:50.195630 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:50.196070 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:50.323154 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:50.330460 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-186db681-9419-43a1-944f-175333c1f37c tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.147165 May 05 14:37:50.330986 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1550/3405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:50 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:37:50.545742 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-bfcfc016-dd33-467d-832e-bdd5228e6280 req-30f09835-eebd-44f2-83d7-b8014bb3a7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be697ed3-253f-4b3a-b348-2ae4925d2978", "name": "network-vif-plugged", "status": "completed", "tag": "cddc588a-3a0b-4930-84e9-56671c29db25"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:37:50.554308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-bfcfc016-dd33-467d-832e-bdd5228e6280 req-30f09835-eebd-44f2-83d7-b8014bb3a7b4 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:50.554749 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-bfcfc016-dd33-467d-832e-bdd5228e6280 req-30f09835-eebd-44f2-83d7-b8014bb3a7b4 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:50.565178 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-bfcfc016-dd33-467d-832e-bdd5228e6280 req-30f09835-eebd-44f2-83d7-b8014bb3a7b4 service nova] Creating event network-vif-plugged:cddc588a-3a0b-4930-84e9-56671c29db25 for instance be697ed3-253f-4b3a-b348-2ae4925d2978 on hv-cinder-73761 May 05 14:37:50.570200 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-bfcfc016-dd33-467d-832e-bdd5228e6280 req-30f09835-eebd-44f2-83d7-b8014bb3a7b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028094 May 05 14:37:50.570772 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1856/3406] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:37:51.347214 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:51.347829 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:51.354212 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:51.354657 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:51.355411 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:51.355849 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:51.492611 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:51.500640 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-cc1a555e-0d57-4f91-b794-c476b5014ac0 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1266 microversion: 2.1 time: 0.157415 May 05 14:37:51.501209 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1551/3407] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:51 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:52.519526 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:52.520682 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:52.526991 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:52.527444 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:52.528219 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:52.528663 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:52.656757 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:52.664790 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-932a4e21-f4a3-4aab-92ff-7bb1e9c0df71 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1452 microversion: 2.1 time: 0.150093 May 05 14:37:52.665355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1857/3408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:52 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:52.680410 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:37:52.681022 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:37:52.687236 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:52.687680 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:52.688432 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:52.688866 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:52.819180 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:37:52.826653 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-58b707cc-5f59-4469-b9f1-ee4b3641bcca tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1452 microversion: 2.1 time: 0.149983 May 05 14:37:52.827227 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1552/3409] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:37:52 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:37:54.836546 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-8356c289-f5d0-465d-b7d0-7a41a7c69f74 req-9f9e8c66-16ac-4203-b93e-147337db343e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be697ed3-253f-4b3a-b348-2ae4925d2978", "tag": "cddc588a-3a0b-4930-84e9-56671c29db25"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:37:54.844402 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8356c289-f5d0-465d-b7d0-7a41a7c69f74 req-9f9e8c66-16ac-4203-b93e-147337db343e service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:37:54.844847 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8356c289-f5d0-465d-b7d0-7a41a7c69f74 req-9f9e8c66-16ac-4203-b93e-147337db343e service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:37:54.855633 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-8356c289-f5d0-465d-b7d0-7a41a7c69f74 req-9f9e8c66-16ac-4203-b93e-147337db343e service nova] Creating event network-changed:cddc588a-3a0b-4930-84e9-56671c29db25 for instance be697ed3-253f-4b3a-b348-2ae4925d2978 on hv-cinder-73761 May 05 14:37:54.860661 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-8356c289-f5d0-465d-b7d0-7a41a7c69f74 req-9f9e8c66-16ac-4203-b93e-147337db343e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101995 May 05 14:37:54.861297 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1858/3410] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:39:34.434260 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:34.434792 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:34.437060 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-58282a13-9dfb-4641-b5b7-8f2ccb434a49 req-a4a2ae6d-3d60-408f-a8ac-73b4d1ddfde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be697ed3-253f-4b3a-b348-2ae4925d2978", "tag": "cddc588a-3a0b-4930-84e9-56671c29db25"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:39:34.440932 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:34.441391 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:34.442196 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:34.442636 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:34.445503 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-58282a13-9dfb-4641-b5b7-8f2ccb434a49 req-a4a2ae6d-3d60-408f-a8ac-73b4d1ddfde3 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:34.446034 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-58282a13-9dfb-4641-b5b7-8f2ccb434a49 req-a4a2ae6d-3d60-408f-a8ac-73b4d1ddfde3 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:34.457355 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-58282a13-9dfb-4641-b5b7-8f2ccb434a49 req-a4a2ae6d-3d60-408f-a8ac-73b4d1ddfde3 service nova] Creating event network-changed:cddc588a-3a0b-4930-84e9-56671c29db25 for instance be697ed3-253f-4b3a-b348-2ae4925d2978 on hv-cinder-73761 May 05 14:39:34.462658 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-58282a13-9dfb-4641-b5b7-8f2ccb434a49 req-a4a2ae6d-3d60-408f-a8ac-73b4d1ddfde3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030989 May 05 14:39:34.463621 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1859/3411] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:39:34.467782 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:39:34.729223 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-fe6ef4f8-5006-4757-bcff-cb894a629482 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 204 len: 0 microversion: 2.1 time: 0.299929 May 05 14:39:34.729812 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1553/3412] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:39:34 2022] DELETE /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:39:34.738714 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:34.740079 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:34.746456 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:34.746904 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:34.747867 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:34.748308 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:34.930172 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:34.937866 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3c51fe2f-3bd3-410b-ab8e-c9dfe7f12e50 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1577 microversion: 2.1 time: 0.203516 May 05 14:39:34.938505 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1860/3413] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:34 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:39:35.956710 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:35.957404 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:35.964252 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:35.965034 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:35.965967 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:35.966447 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:36.098345 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:36.106610 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-b1ea1674-5eb3-4423-8029-d20604da50b6 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1577 microversion: 2.1 time: 0.154074 May 05 14:39:36.107185 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1554/3414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:35 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:39:36.842939 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-2850932c-b2d3-4a1c-ba46-0bea4764579d req-f14b9a97-d8f9-4876-a8b3-fb50966c0b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be697ed3-253f-4b3a-b348-2ae4925d2978", "name": "network-vif-deleted", "tag": "cddc588a-3a0b-4930-84e9-56671c29db25"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:39:36.850808 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-2850932c-b2d3-4a1c-ba46-0bea4764579d req-f14b9a97-d8f9-4876-a8b3-fb50966c0b2f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:36.851253 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-2850932c-b2d3-4a1c-ba46-0bea4764579d req-f14b9a97-d8f9-4876-a8b3-fb50966c0b2f service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:36.862498 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-2850932c-b2d3-4a1c-ba46-0bea4764579d req-f14b9a97-d8f9-4876-a8b3-fb50966c0b2f service nova] Creating event network-vif-deleted:cddc588a-3a0b-4930-84e9-56671c29db25 for instance be697ed3-253f-4b3a-b348-2ae4925d2978 on hv-cinder-73761 May 05 14:39:36.867681 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-2850932c-b2d3-4a1c-ba46-0bea4764579d req-f14b9a97-d8f9-4876-a8b3-fb50966c0b2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076653 May 05 14:39:36.868336 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1861/3415] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:39:37.123945 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:37.125197 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:37.132584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:37.133029 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:37.133985 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:37.134450 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:37.204322 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:37.211901 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-c49cd052-05b9-45d5-9a41-27598dc395bb tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 200 len: 1226 microversion: 2.1 time: 0.091950 May 05 14:39:37.212534 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1555/3416] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:37 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:39:38.236617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:38.236617 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: be697ed3-253f-4b3a-b348-2ae4925d2978] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:38.239156 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:38.239609 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:38.240382 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:38.240820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:38.255877 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] HTTP exception thrown: Instance be697ed3-253f-4b3a-b348-2ae4925d2978 could not be found. May 05 14:39:38.256463 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Returning 404 to user: Instance be697ed3-253f-4b3a-b348-2ae4925d2978 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:39:38.257280 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-3110d2d4-4229-43f9-857e-e6ade3c4dc34 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978" status: 404 len: 111 microversion: 2.1 time: 0.032358 May 05 14:39:38.257822 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1862/3417] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:38 2022] GET /compute/v2.1/servers/be697ed3-253f-4b3a-b348-2ae4925d2978 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:39:41.963934 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:41.964439 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:41.967070 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-8aed004e-5ab1-457b-ac26-188aa902fff3 req-64584e22-c5e1-40f9-a11d-ef713cc18de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67167cd-e478-4c74-a50a-b23979b18a22", "tag": "72d483ca-18c2-4311-ae00-86033cec4c01"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:39:41.971060 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:41.971511 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:41.972316 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:41.972965 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:41.977048 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8aed004e-5ab1-457b-ac26-188aa902fff3 req-64584e22-c5e1-40f9-a11d-ef713cc18de1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:41.977588 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-8aed004e-5ab1-457b-ac26-188aa902fff3 req-64584e22-c5e1-40f9-a11d-ef713cc18de1 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:41.995820 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-8aed004e-5ab1-457b-ac26-188aa902fff3 req-64584e22-c5e1-40f9-a11d-ef713cc18de1 service nova] Creating event network-changed:72d483ca-18c2-4311-ae00-86033cec4c01 for instance f67167cd-e478-4c74-a50a-b23979b18a22 on hv-cinder-73761 May 05 14:39:42.000343 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Going to try to terminate instance {{(pid=123931) delete /opt/stack/nova/nova/compute/api.py:2664}} May 05 14:39:42.000998 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-8aed004e-5ab1-457b-ac26-188aa902fff3 req-64584e22-c5e1-40f9-a11d-ef713cc18de1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038435 May 05 14:39:42.001845 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1863/3418] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:39:42.300774 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-26efcdf5-51ed-4e7d-983a-78b01b431df3 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 204 len: 0 microversion: 2.1 time: 0.340582 May 05 14:39:42.301585 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1556/3419] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:39:41 2022] DELETE /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 05 14:39:42.316709 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:42.317559 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:42.324238 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:42.324821 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:42.325673 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:42.326318 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:42.464126 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.policy [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123930) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:42.471542 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-2bdda32b-d058-4815-b4a2-bd0d3da095de tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1577 microversion: 2.1 time: 0.159113 May 05 14:39:42.472104 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1864/3420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:42 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:39:43.489206 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:43.489909 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:43.496256 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:43.496706 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:43.497499 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:43.497937 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:43.633560 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:43.640936 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-92e599e9-6af6-43bf-8c18-4e3b6cbff1e9 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1577 microversion: 2.1 time: 0.155949 May 05 14:39:43.641500 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1557/3421] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:43 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 05 14:39:44.293784 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [req-f2c31912-0b2d-42f9-8841-b7a14d37c2f3 req-0234d980-3821-4064-8526-472c3f97cf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67167cd-e478-4c74-a50a-b23979b18a22", "name": "network-vif-deleted", "tag": "72d483ca-18c2-4311-ae00-86033cec4c01"}]} {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 05 14:39:44.302232 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f2c31912-0b2d-42f9-8841-b7a14d37c2f3 req-0234d980-3821-4064-8526-472c3f97cf82 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:44.302678 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [req-f2c31912-0b2d-42f9-8841-b7a14d37c2f3 req-0234d980-3821-4064-8526-472c3f97cf82 service nova] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:44.313220 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.compute.server_external_events [req-f2c31912-0b2d-42f9-8841-b7a14d37c2f3 req-0234d980-3821-4064-8526-472c3f97cf82 service nova] Creating event network-vif-deleted:72d483ca-18c2-4311-ae00-86033cec4c01 for instance f67167cd-e478-4c74-a50a-b23979b18a22 on hv-cinder-73761 May 05 14:39:44.318580 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [req-f2c31912-0b2d-42f9-8841-b7a14d37c2f3 req-0234d980-3821-4064-8526-472c3f97cf82 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027923 May 05 14:39:44.319155 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1865/3422] 10.222.0.26 () {64 vars in 1317 bytes} [Thu May 5 14:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 05 14:39:44.658584 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:44.659199 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:44.666072 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:44.667497 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:44.667931 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:44.668383 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:44.732502 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.policy [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45c51cdca57f49ad98a58c9affb7e6b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a084d2891c54840b90480c5b8aa4e6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123931) authorize /opt/stack/nova/nova/policy.py:199}} May 05 14:39:44.740476 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-2f4d354a-d00b-462e-8527-41b5d331626b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 200 len: 1225 microversion: 2.1 time: 0.085317 May 05 14:39:44.741035 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1558/3423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:44 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 05 14:39:45.758344 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:45.759044 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: f67167cd-e478-4c74-a50a-b23979b18a22] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:45.765199 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:45.765647 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:45.766497 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:45.766932 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:45.780454 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] HTTP exception thrown: Instance f67167cd-e478-4c74-a50a-b23979b18a22 could not be found. May 05 14:39:45.781029 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Returning 404 to user: Instance f67167cd-e478-4c74-a50a-b23979b18a22 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:39:45.781833 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-854a86a7-cb3b-4248-a542-9b1d916bcc85 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22" status: 404 len: 111 microversion: 2.1 time: 0.028649 May 05 14:39:45.782377 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1866/3424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:45 2022] GET /compute/v2.1/servers/f67167cd-e478-4c74-a50a-b23979b18a22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:39:46.302733 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:46.303219 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.compute.api [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123931) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:46.310394 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:46.310843 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:46.311604 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:46.312037 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG oslo_concurrency.lockutils [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:46.324959 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.wsgi [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] HTTP exception thrown: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. May 05 14:39:46.325882 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Returning 404 to user: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. {{(pid=123931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:39:46.326743 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-5b28e20d-fb5c-43b4-963c-1c03991ac425 tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 404 len: 111 microversion: 2.1 time: 0.027923 May 05 14:39:46.327289 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1559/3425] 10.222.0.26 () {58 vars in 1238 bytes} [Thu May 5 14:39:46 2022] DELETE /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:39:46.335997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '>' {{(pid=123930) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:46.335997 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.compute.api [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] [instance: 52c5107d-9622-4f16-92cc-e3536d00f8b7] Fetching instance by UUID {{(pid=123930) get /opt/stack/nova/nova/compute/api.py:2918}} May 05 14:39:46.343426 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:46.343876 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:46.344636 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 05 14:39:46.345078 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Lock "b8fe454e-7513-4ff7-93a5-967e7a71a07d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123930) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 05 14:39:46.358693 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.wsgi [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] HTTP exception thrown: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. May 05 14:39:46.359269 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: DEBUG nova.api.openstack.wsgi [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Returning 404 to user: Instance 52c5107d-9622-4f16-92cc-e3536d00f8b7 could not be found. {{(pid=123930) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} May 05 14:39:46.360080 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: INFO nova.api.openstack.requestlog [None req-82e0bfcc-aece-4004-bb3a-bd2a15da7e6e tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7" status: 404 len: 111 microversion: 2.1 time: 0.028631 May 05 14:39:46.360600 dv-cinder-737618-3-iscsi devstack@n-api.service[123930]: [pid: 123930|app: 0|req: 1867/3426] 10.222.0.26 () {58 vars in 1235 bytes} [Thu May 5 14:39:46 2022] GET /compute/v2.1/servers/52c5107d-9622-4f16-92cc-e3536d00f8b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 05 14:39:47.876648 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: DEBUG nova.api.openstack.wsgi [None req-ab171eca-1e5c-4a5e-9013-5fffc3a9453b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] Calling method '.version_select at 0x7fb4e2fda550>' {{(pid=123931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 05 14:39:47.981745 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: INFO nova.api.openstack.requestlog [None req-ab171eca-1e5c-4a5e-9013-5fffc3a9453b tempest-TestVolumeBootPattern-773345099 tempest-TestVolumeBootPattern-773345099-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1052745510" status: 202 len: 0 microversion: 2.1 time: 0.108901 May 05 14:39:47.982371 dv-cinder-737618-3-iscsi devstack@n-api.service[123931]: [pid: 123931|app: 0|req: 1560/3427] 10.222.0.26 () {58 vars in 1262 bytes} [Thu May 5 14:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1052745510 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)